Apr 13 11:12:28 devstack cinder-volume[72404]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 11:12:28 devstack cinder-volume[72404]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 11:12:28 devstack cinder-volume[72404]: we strongly recommend against using it for new projects.
Apr 13 11:12:28 devstack cinder-volume[72404]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 11:12:28 devstack cinder-volume[72404]: framework.  For more detail see
Apr 13 11:12:28 devstack cinder-volume[72404]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 11:12:28 devstack cinder-volume[72404]:   import eventlet  # noqa
Apr 13 11:12:30 devstack cinder-volume[72404]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:12:30 devstack cinder-volume[72404]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:12:30 devstack cinder-volume[72404]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO dbcounter [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Registered counter for database cinder
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_db.sqlalchemy.engines [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG dbcounter [-] [72404] Writer thread running {{(pid=72404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.rpc [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.rpc [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_db.sqlalchemy.engines [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.volume.manager [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Determined volume DB was empty at startup.
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG cinder.volume.manager [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72404) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.volume.manager [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 11:12:31 devstack cinder-volume[72404]: WARNING stevedore.named [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 11:12:31 devstack cinder-volume[72404]: WARNING castellan.key_manager [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:12:31 devstack cinder-volume[72404]: WARNING cinder.keymgr.conf_key_mgr [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG cinder.volume.drivers.lvm [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72404) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_concurrency.processutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72404) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_concurrency.processutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] CMD "cinder-rtstool verify" returned: 0 in 0.225s {{(pid=72404) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_db.sqlalchemy.engines [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.rpc [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.rpc [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 13 11:12:31 devstack cinder-volume[72404]: WARNING stevedore.named [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 11:12:31 devstack cinder-volume[72404]: WARNING castellan.key_manager [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO cinder.volume.manager [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_db.sqlalchemy.engines [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:12:31 devstack cinder-volume[72404]: INFO oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Starting 1 workers
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Started child 72510 {{(pid=72404) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Full set of CONF: {{(pid=72404) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] ******************************************************************************** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Configuration options gathered from: {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] ================================================================================ {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] allow_availability_zone_fallback = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] allow_compression_on_image_upload = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] allowed_direct_url_schemes     = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] api_rate_limit                 = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] auth_strategy                  = keystone {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] az_cache_duration              = 3600 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_availability_zone      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_host                   = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_name                   = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_stats_polling_interval = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backup_api_class               = cinder.backup.api.API {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backup_name_template           = backup-%s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backup_use_same_host           = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backup_use_temp_snapshot       = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] chap_password                  = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] chap_username                  =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72510]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_internal_tenant_project_id = e53a209b178c4079aa448f7a1179ca07 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_internal_tenant_user_id = e40bfda3b6984bfea6e6a4e6569ba4e7 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cloned_volume_same_az          = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cluster                        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] compression_format             = gzip {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] config_dir                     = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] config_source                  = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] control_exchange               = openstack {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] debug                          = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] default_availability_zone      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] default_group_type             = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] default_volume_type            = lvmdriver-1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] disk_geometry                  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] driver_client_cert             = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] driver_client_cert_key         = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] driver_data_namespace          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] driver_ssl_cert_path           = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] driver_ssl_cert_verify         = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] driver_use_ssl                 = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] enable_force_upload            = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] enable_new_services            = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] enable_unsupported_driver      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] enforce_multipath_for_image_xfer = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] filter_function                = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_api_insecure            = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_api_ssl_compression     = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_ca_certificates_file    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_certfile                = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_keyfile                 = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_num_retries             = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance_request_timeout         = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] goodness_function              = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] graceful_shutdown_timeout      = 5 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] group_api_class                = cinder.group.api.API {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] host                           = devstack {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_compress_on_upload       = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_conversion_address_space_limit = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_conversion_cpu_limit     = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_conversion_disable       = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_upload_use_cinder_backend = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_upload_use_internal_tenant = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_volume_cache_enabled     = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_volume_cache_max_count   = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] image_volume_cache_max_size_gb = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] init_host_max_objects_retrieval = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] iscsi_target_flags             =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] iscsi_write_cache              = on {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] iser_helper                    = tgtadm {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] iser_ip_address                = 192.168.122.135 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] iser_port                      = 3260 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_color                      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_config_append              = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_dir                        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_file                       = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_options                    = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_rotate_interval            = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_rotate_interval_type       = days {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] log_rotation_type              = none {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] max_age                        = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] max_logfile_count              = 30 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] max_logfile_size_mb            = 200 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] max_over_subscription_ratio    = 20.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] message_reap_interval          = 86400 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] message_ttl                    = 2592000 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] migration_create_volume_timeout_secs = 300 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] monkey_patch                   = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] monkey_patch_modules           = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] my_ip                          = 192.168.122.135 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] no_snapshot_gb_quota           = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] num_iser_scan_tries            = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] num_shell_tries                = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] num_volume_device_scan_tries   = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] nvmeof_conn_info_version       = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] nvmet_ns_id                    = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] nvmet_port_id                  = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_max_limit                = 1000 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_volume_ext_list          = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_volume_listen_port       = 8776 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_volume_use_ssl           = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] osapi_volume_workers           = 2 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] per_volume_size_limit          = -1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] periodic_fuzzy_delay           = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] periodic_interval              = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] public_endpoint                = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] publish_errors                 = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_backup_gigabytes         = 1000 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_backups                  = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_gigabytes                = 1000 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_groups                   = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_snapshots                = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] quota_volumes                  = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] rate_limit_burst               = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] rate_limit_except_level        = CRITICAL {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] rate_limit_interval            = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] reinit_driver_count            = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] replication_device             = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] report_discard_supported       = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] report_interval                = 120 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] reservation_clean_interval     = 86400 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] reservation_expire             = 86400 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] reserved_image_namespaces      = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] reserved_percentage            = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] rpc_response_timeout           = 120 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] run_external_periodic_tasks    = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] scst_target_driver             = iscsi {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] scst_target_iqn_name           = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_down_time              = 720 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] shell_completion               = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] snapshot_name_template         = snapshot-%s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] snapshot_same_host             = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] split_loggers                  = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] state_path                     = /opt/stack/data/cinder {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] storage_availability_zone      = nova {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] storage_protocol               = iSCSI {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] syslog_log_facility            = LOG_USER {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] target_helper                  = lioadm {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] target_ip_address              = 192.168.122.135 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] target_port                    = 3260 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] target_protocol                = iscsi {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] target_secondary_ip_addresses  = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] trace_flags                    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] transport_url                  = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] until_refresh                  = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_chap_auth                  = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_default_quota_class        = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_journal                    = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_json                       = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_multipath_for_image_xfer   = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_stderr                     = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] use_syslog                     = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] verify_glance_signatures       = enabled {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_api_class               = cinder.volume.api.API {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_backend_name            = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_clear                   = zero {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_clear_ionice            = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_clear_size              = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_copy_bps_limit          = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_dd_blocksize            = 1M {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_name_template           = volume-%s {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_service_inithost_offload = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volume_usage_audit_period      = month {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] zoning_mode                    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_concurrency.disable_process_locking = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.admin_password = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.admin_token = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.admin_user  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_protocol = https {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_section = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_type   = password {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_uri    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.auth_version = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.cache       = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.certfile    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.identity_uri = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.include_service_catalog = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.insecure    = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.interface   = public {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.keyfile     = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_password =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcache_username =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.region_name = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.service_type = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.backend                  = dogpile.cache.null {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.backend_argument         = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.backend_expiration_time  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.config_prefix            = cache.oslo {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.debug_cache_backend      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.enable_retry_client      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.enable_socket_keepalive  = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.enabled                  = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.enforce_fips_mode        = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.expiration_time          = 600 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.hashclient_retry_attempts = 2 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_dead_retry      = 300 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_sasl_enabled    = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.password                 = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.proxies                  = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.redis_db                 = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.redis_server             = localhost:6379 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.retry_attempts           = 2 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.retry_delay              = 0.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.socket_keepalive_count   = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.socket_keepalive_idle    = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.socket_keepalive_interval = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.socket_timeout           = 1.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.tls_allowed_ciphers      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.tls_cafile               = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.tls_certfile             = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.tls_enabled              = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.tls_keyfile              = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cache.username                 = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] coordination.backend_url       = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.asyncio_connection    = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.asyncio_slave_connection = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.backend               = sqlalchemy {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.connection            = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.connection_debug      = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.connection_parameters =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.connection_recycle_time = 3600 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.connection_trace      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.db_inc_retry_interval = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.db_max_retries        = 20 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.db_max_retry_interval = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.db_retry_interval     = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.max_overflow          = 50 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.max_pool_size         = 5 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.max_retries           = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.mysql_wsrep_sync_wait = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.pool_timeout          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.retry_interval        = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.slave_connection      = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.sqlite_synchronous    = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.synchronous_reader    = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] database.use_db_reconnect      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72510]: INFO cinder.volume.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.connection_string     = messaging:// {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.enabled               = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.es_doc_type           = notification {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.es_scroll_size        = 10000 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.es_scroll_time        = 2m {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.filter_error_trace    = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.hmac_keys             = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.sentinel_service_name = mymaster {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.socket_timeout        = 0.1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.trace_requests        = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler.trace_sqlalchemy      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler_jaeger.process_tags   = {} {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler_jaeger.service_name_prefix = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] profiler_otlp.service_name_prefix = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.enforce_new_defaults = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: WARNING oslo_config.cfg [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.enforce_scope      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.policy_default_rule = default {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.group          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.helper_command = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] privsep_osbrick.user           = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.group         = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.helper_command = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] cinder_sys_admin.user          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.auth_section      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.auth_type         = password {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.cafile            = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.certfile          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.collect_timing    = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.insecure          = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.keyfile           = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.send_service_user_token = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.split_loggers     = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] service_user.timeout           = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.auth_section            = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.auth_type               = password {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.certfile                = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.collect_timing          = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.insecure                = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.keyfile                 = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.region_name             = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.split_loggers           = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] glance.timeout                 = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.backend_availability_zone = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.chap_password = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.chap_username =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.disk_geometry = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.driver_client_cert = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.driver_client_cert_key = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.driver_data_namespace = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.driver_use_ssl = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.extra_capabilities = {} {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.filter_function = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.goodness_function = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.iscsi_target_flags =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.iscsi_write_cache = on {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.iser_port     = 3260 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.lvm_share_target = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.lvm_type      = auto {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.num_shell_tries = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.replication_device = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.report_discard_supported = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.reserved_percentage = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.target_helper = tgtadm {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.target_port   = 3260 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.target_protocol = iscsi {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.trace_flags   = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.unique_fqdn_network = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.use_chap_auth = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_backend_name = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_clear  = zero {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_clear_ionice = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_clear_size = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_reports.file_event_handler = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_reports.log_dir           = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.backend_host       = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.chap_password      = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.chap_username      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.disk_geometry      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.driver_client_cert = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.extra_capabilities = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.filter_function    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.goodness_function  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.iser_helper        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.iser_port          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.lvm_type           = auto {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.replication_device = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.report_discard_supported = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.reserved_percentage = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.scst_target_driver = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.storage_protocol   = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.target_ip_address  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.target_port        = 3260 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.trace_flags        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_clear       = zero {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] lvmdriver-1.volumes_dir        = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_notifications.driver = [] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_notifications.retry = -1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] key_manager.fixed_key          = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.barbican_api_version  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.barbican_endpoint     = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.barbican_endpoint_type = public {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.barbican_region_name  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.cafile                = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.certfile              = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.collect_timing        = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.insecure              = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.keyfile               = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.number_of_retries     = 60 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.retry_delay           = 1 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.send_service_user_token = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.split_loggers         = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.timeout               = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.verify_ssl            = True {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican.verify_ssl_path       = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.auth_section = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.auth_type = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.cafile   = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.certfile = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.collect_timing = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.insecure = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.keyfile  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.split_loggers = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] barbican_service_user.timeout  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.approle_role_id          = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.approle_secret_id        = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.kv_mountpoint            = secret {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.kv_path                  = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.kv_version               = 2 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.namespace                = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.root_token_id            = **** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.ssl_ca_crt_file          = None {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.timeout                  = 60.0 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.use_ssl                  = False {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:12:31 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] ******************************************************************************** {{(pid=72404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:31 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:31 devstack sudo[72514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 13 11:12:31 devstack sudo[72514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:32 devstack sudo[72514]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:32 devstack sudo[72608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:32 devstack sudo[72608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:32 devstack sudo[72608]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.539s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:12:32 devstack cinder-volume[72510]: INFO cinder.brick.local_dev.lvm [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:32 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:32 devstack sudo[72854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:12:32 devstack sudo[72854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:33 devstack sudo[72854]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:33 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:33 devstack cinder-volume[72510]: DEBUG cinder.brick.local_dev.lvm [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72510) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 13 11:12:33 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:33 devstack sudo[73010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:33 devstack sudo[73010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:34 devstack sudo[73010]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.937s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:34 devstack sudo[73171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:34 devstack sudo[73171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:34 devstack sudo[73171]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:34 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:34 devstack sudo[73210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 13 11:12:34 devstack sudo[73210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:35 devstack sudo[73210]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:35 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.431s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:35 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:35 devstack sudo[73213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:12:35 devstack sudo[73213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:35 devstack sudo[73213]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:35 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:35 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:35 devstack sudo[73218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:12:35 devstack sudo[73218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:36 devstack sudo[73218]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:36 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:36 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:36 devstack sudo[73221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:36 devstack sudo[73221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:36 devstack sudo[73221]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:36 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:36 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:36 devstack sudo[73226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:36 devstack sudo[73226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:37 devstack sudo[73226]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:37 devstack sudo[73234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:37 devstack sudo[73234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:37 devstack sudo[73234]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.549s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:37 devstack cinder-volume[72510]: INFO cinder.volume.drivers.lvm [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:37 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:37 devstack sudo[73278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:37 devstack sudo[73278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:38 devstack sudo[73278]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:38 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:38 devstack cinder-volume[72510]: DEBUG cinder.volume.drivers.lvm [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Updating volume stats {{(pid=72510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 11:12:38 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:38 devstack sudo[73356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:12:38 devstack sudo[73356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:38 devstack sudo[73356]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:38 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:38 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:38 devstack sudo[73498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:38 devstack sudo[73498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:39 devstack sudo[73498]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:39 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:39 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:39 devstack sudo[73501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:39 devstack sudo[73501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:39 devstack sudo[73501]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:39 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.491s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:39 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:39 devstack sudo[73504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:39 devstack sudo[73504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:40 devstack sudo[73504]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:40 devstack cinder-volume[72510]: INFO cinder.volume.driver [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG cinder.volume.driver [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72510) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG oslo_db.sqlalchemy.engines [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG dbcounter [-] [72510] Writer thread running {{(pid=72510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG cinder.db.sqlalchemy.api [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Building query based on filter {{(pid=72510) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG cinder.image.image_utils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72510) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 11:12:40 devstack cinder-volume[72510]: INFO cinder.keymgr.migration [None req-695bc81f-6dc5-4e0d-9a6e-667f3709ec5c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG cinder.volume.drivers.lvm [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Updating volume stats {{(pid=72510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:40 devstack sudo[73509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:12:40 devstack sudo[73509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:40 devstack sudo[73509]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:40 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:40 devstack sudo[73515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:40 devstack sudo[73515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:41 devstack sudo[73515]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:41 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:41 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:41 devstack sudo[73520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:41 devstack sudo[73520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:41 devstack cinder-volume[72404]: DEBUG dbcounter [-] [72404] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:12:41 devstack sudo[73520]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:41 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.502s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:41 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:41 devstack sudo[73527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:41 devstack sudo[73527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:42 devstack sudo[73527]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.554s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG cinder.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Notifying Schedulers of capabilities ... {{(pid=72510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:12:42 devstack cinder-volume[72510]: INFO cinder.volume.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Driver initialization completed successfully.
Apr 13 11:12:42 devstack cinder-volume[72510]: INFO cinder.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Initiating service 2 cleanup
Apr 13 11:12:42 devstack cinder-volume[72510]: INFO cinder.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Service 2 cleanup completed.
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG cinder.service [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Creating RPC server for service cinder-volume {{(pid=72510) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG cinder.service [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72510) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 11:12:42 devstack cinder-volume[72510]: INFO cinder.volume.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG cinder.volume.drivers.lvm [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Updating volume stats {{(pid=72510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:42 devstack sudo[73536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:12:42 devstack sudo[73536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:42 devstack sudo[73536]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:42 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:42 devstack sudo[73593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:42 devstack sudo[73593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:43 devstack sudo[73593]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:43 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:43 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:43 devstack sudo[73596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:12:43 devstack sudo[73596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:43 devstack sudo[73596]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:43 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.410s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:43 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:12:43 devstack sudo[73599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:12:43 devstack sudo[73599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:12:44 devstack sudo[73599]: pam_unix(sudo:session): session closed for user root
Apr 13 11:12:44 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:12:44 devstack cinder-volume[72510]: INFO cinder.volume.manager [None req-734888e4-0658-40ff-bd7a-3db454d112b2 None None] Driver post RPC initialization completed successfully.
Apr 13 11:12:52 devstack cinder-volume[72510]: DEBUG dbcounter [-] [72510] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:12:54 devstack cinder-volume[72510]: DEBUG dbcounter [-] [72510] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=72510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:14:15 devstack cinder-volume[72510]: DEBUG oslo_service.periodic_task [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:14:15 devstack cinder-volume[72510]: DEBUG cinder.volume.drivers.lvm [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Updating volume stats {{(pid=72510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 11:14:15 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:14:15 devstack sudo[78627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:14:15 devstack sudo[78627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:14:15 devstack sudo[78627]: pam_unix(sudo:session): session closed for user root
Apr 13 11:14:15 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:14:15 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:14:15 devstack sudo[78630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:14:15 devstack sudo[78630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:14:16 devstack sudo[78630]: pam_unix(sudo:session): session closed for user root
Apr 13 11:14:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:14:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:14:16 devstack sudo[78633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:14:16 devstack sudo[78633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:14:16 devstack sudo[78633]: pam_unix(sudo:session): session closed for user root
Apr 13 11:14:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.447s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:14:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:14:16 devstack sudo[78641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:14:16 devstack sudo[78641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:14:16 devstack sudo[78641]: pam_unix(sudo:session): session closed for user root
Apr 13 11:14:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:14:16 devstack cinder-volume[72510]: DEBUG cinder.manager [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Notifying Schedulers of capabilities ... {{(pid=72510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:14:54 devstack cinder-volume[72510]: DEBUG dbcounter [-] [72510] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:15:15 devstack cinder-volume[72510]: DEBUG oslo_service.periodic_task [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72510) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:15:15 devstack cinder-volume[72510]: DEBUG cinder.volume.drivers.lvm [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Updating volume stats {{(pid=72510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 11:15:15 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:15:15 devstack sudo[80596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 11:15:15 devstack sudo[80596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:15:15 devstack sudo[80596]: pam_unix(sudo:session): session closed for user root
Apr 13 11:15:15 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:15:15 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:15:15 devstack sudo[80599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:15:15 devstack sudo[80599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:15:16 devstack sudo[80599]: pam_unix(sudo:session): session closed for user root
Apr 13 11:15:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:15:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:15:16 devstack sudo[80613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 11:15:16 devstack sudo[80613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:15:16 devstack sudo[80613]: pam_unix(sudo:session): session closed for user root
Apr 13 11:15:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.417s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:15:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:15:16 devstack sudo[80616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 11:15:16 devstack sudo[80616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:15:16 devstack sudo[80616]: pam_unix(sudo:session): session closed for user root
Apr 13 11:15:16 devstack cinder-volume[72510]: DEBUG oslo_concurrency.processutils [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:15:16 devstack cinder-volume[72510]: DEBUG cinder.manager [None req-6805229c-62c3-4c2c-9c90-975038933c92 None None] Notifying Schedulers of capabilities ... {{(pid=72510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:15:57 devstack cinder-volume[72404]: INFO oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Caught SIGTERM, stopping children
Apr 13 11:15:57 devstack cinder-volume[72404]: DEBUG oslo_concurrency.lockutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Acquiring lock "singleton_lock" {{(pid=72404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:15:57 devstack cinder-volume[72404]: DEBUG oslo_concurrency.lockutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Acquired lock "singleton_lock" {{(pid=72404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:15:57 devstack cinder-volume[72404]: DEBUG oslo_concurrency.lockutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Releasing lock "singleton_lock" {{(pid=72404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:15:57 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Stop services. {{(pid=72404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 11:15:57 devstack cinder-volume[72404]: DEBUG oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Killing children. {{(pid=72404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 11:15:57 devstack cinder-volume[72404]: INFO oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Waiting on 1 children to exit
Apr 13 11:16:02 devstack cinder-volume[72510]: DEBUG oslo_concurrency.lockutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Acquiring lock "singleton_lock" {{(pid=72510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:16:02 devstack cinder-volume[72510]: DEBUG oslo_concurrency.lockutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Acquired lock "singleton_lock" {{(pid=72510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:16:02 devstack cinder-volume[72510]: DEBUG oslo_concurrency.lockutils [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Releasing lock "singleton_lock" {{(pid=72510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:16:02 devstack cinder-volume[72510]: WARNING amqp [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 11:16:02 devstack cinder-volume[72510]: WARNING amqp [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 11:16:02 devstack cinder-volume[72404]: INFO oslo_service.backend._eventlet.service [None req-8f00505c-3b2c-400d-a131-16972b03fd58 None None] Child 72510 exited with status 0
Apr 13 11:16:02 devstack cinder-volume[81560]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 11:16:02 devstack cinder-volume[81560]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 11:16:02 devstack cinder-volume[81560]: we strongly recommend against using it for new projects.
Apr 13 11:16:02 devstack cinder-volume[81560]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 11:16:02 devstack cinder-volume[81560]: framework.  For more detail see
Apr 13 11:16:02 devstack cinder-volume[81560]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 11:16:02 devstack cinder-volume[81560]:   import eventlet  # noqa
Apr 13 11:16:04 devstack cinder-volume[81560]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81560) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:16:04 devstack cinder-volume[81560]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81560) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:16:04 devstack cinder-volume[81560]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81560) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO dbcounter [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Registered counter for database cinder
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_db.sqlalchemy.engines [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG dbcounter [-] [81560] Writer thread running {{(pid=81560) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO cinder.rpc [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO cinder.rpc [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_db.sqlalchemy.engines [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO cinder.volume.manager [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Determined volume DB was empty at startup.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG cinder.volume.manager [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81560) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO cinder.volume.manager [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 11:16:05 devstack cinder-volume[81560]: WARNING stevedore.named [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 11:16:05 devstack cinder-volume[81560]: WARNING castellan.key_manager [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:16:05 devstack cinder-volume[81560]: WARNING cinder.keymgr.conf_key_mgr [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO cinder.volume.manager [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_db.sqlalchemy.engines [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:05 devstack cinder-volume[81560]: INFO oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Starting 1 workers
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Started child 81674 {{(pid=81560) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Full set of CONF: {{(pid=81560) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] ******************************************************************************** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Configuration options gathered from: {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] ================================================================================ {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] allow_availability_zone_fallback = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] allow_compression_on_image_upload = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] allowed_direct_url_schemes     = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] api_rate_limit                 = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] auth_strategy                  = keystone {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_availability_zone      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_host                   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_name                   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_stats_polling_interval = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backup_api_class               = cinder.backup.api.API {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backup_name_template           = backup-%s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backup_use_same_host           = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backup_use_temp_snapshot       = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] chap_password                  = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] chap_username                  =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_internal_tenant_project_id = e53a209b178c4079aa448f7a1179ca07 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_internal_tenant_user_id = e40bfda3b6984bfea6e6a4e6569ba4e7 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cluster                        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] compression_format             = gzip {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] compute_api_class              = cinder.compute.nova.API {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] config_dir                     = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] config_source                  = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] control_exchange               = openstack {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] debug                          = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] default_availability_zone      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] default_group_type             = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81674]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] default_volume_type            = QuobyteHD {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] disk_geometry                  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] driver_client_cert             = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] driver_client_cert_key         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] driver_data_namespace          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] driver_ssl_cert_path           = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] driver_ssl_cert_verify         = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] driver_use_ssl                 = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] enable_new_services            = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] enable_unsupported_driver      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] enabled_backends               = ['QuobyteHD'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] enforce_multipath_for_image_xfer = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] filter_function                = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_api_insecure            = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_api_ssl_compression     = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_ca_certificates_file    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_catalog_info            = image:glance:publicURL {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_certfile                = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_keyfile                 = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_num_retries             = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance_request_timeout         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] goodness_function              = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] graceful_shutdown_timeout      = 5 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] group_api_class                = cinder.group.api.API {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] host                           = devstack {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_compress_on_upload       = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_conversion_address_space_limit = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_conversion_cpu_limit     = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_conversion_disable       = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_upload_use_cinder_backend = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_upload_use_internal_tenant = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_volume_cache_enabled     = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_volume_cache_max_count   = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] image_volume_cache_max_size_gb = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] init_host_max_objects_retrieval = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] instance_format                = [instance: %(uuid)s]  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] iscsi_target_flags             =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] iscsi_write_cache              = on {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] iser_helper                    = tgtadm {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] iser_ip_address                = 192.168.122.135 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] iser_port                      = 3260 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_color                      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_config_append              = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_dir                        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_file                       = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_options                    = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_rotate_interval            = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_rotate_interval_type       = days {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] log_rotation_type              = none {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] max_age                        = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] max_logfile_count              = 30 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] max_logfile_size_mb            = 200 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] max_over_subscription_ratio    = 20.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] message_reap_interval          = 86400 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] message_ttl                    = 2592000 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] migration_create_volume_timeout_secs = 300 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] monkey_patch                   = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] monkey_patch_modules           = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] my_ip                          = 192.168.122.135 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] no_snapshot_gb_quota           = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] num_iser_scan_tries            = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] num_shell_tries                = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] num_volume_device_scan_tries   = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] nvmeof_conn_info_version       = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] nvmet_ns_id                    = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] nvmet_port_id                  = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_max_limit                = 1000 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_volume_ext_list          = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_volume_listen_port       = 8776 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_volume_use_ssl           = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] osapi_volume_workers           = 2 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] per_volume_size_limit          = -1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] periodic_fuzzy_delay           = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] periodic_interval              = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] public_endpoint                = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] publish_errors                 = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_backup_gigabytes         = 1000 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_backups                  = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_gigabytes                = 1000 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_groups                   = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_snapshots                = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] quota_volumes                  = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81674]: INFO cinder.volume.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.remotefs [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81674) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] rate_limit_burst               = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] rate_limit_except_level        = CRITICAL {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] rate_limit_interval            = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] reinit_driver_count            = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] replication_device             = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] report_discard_supported       = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] report_interval                = 120 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] reservation_clean_interval     = 86400 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] reservation_expire             = 86400 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] reserved_image_namespaces      = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] reserved_percentage            = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] rpc_response_timeout           = 120 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] run_external_periodic_tasks    = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] scst_target_driver             = iscsi {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] scst_target_iqn_name           = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_down_time              = 720 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] shell_completion               = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] snapshot_name_template         = snapshot-%s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] split_loggers                  = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] state_path                     = /opt/stack/data/cinder {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] storage_availability_zone      = nova {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] storage_protocol               = iSCSI {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] syslog_log_facility            = LOG_USER {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] target_helper                  = lioadm {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] target_ip_address              = 192.168.122.135 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] target_port                    = 3260 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] target_protocol                = iscsi {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] target_secondary_ip_addresses  = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] trace_flags                    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] transport_url                  = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] until_refresh                  = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_chap_auth                  = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_default_quota_class        = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_journal                    = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_json                       = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_multipath_for_image_xfer   = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_stderr                     = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] use_syslog                     = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] verify_glance_signatures       = enabled {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_api_class               = cinder.volume.api.API {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_backend_name            = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_clear                   = zero {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_clear_ionice            = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_clear_size              = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_copy_bps_limit          = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_dd_blocksize            = 1M {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_name_template           = volume-%s {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_service_inithost_offload = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volume_usage_audit_period      = month {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] zoning_mode                    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_concurrency.disable_process_locking = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.admin_password = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.admin_token = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.admin_user  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_port   = 35357 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_protocol = https {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_section = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_type   = password {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_uri    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.auth_version = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.cache       = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.certfile    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.delay_auth_decision = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.http_connect_timeout = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.identity_uri = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.include_service_catalog = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.insecure    = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.interface   = public {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.keyfile     = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_password =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcache_username =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.region_name = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.service_token_roles_required = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.service_type = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.token_cache_time = 300 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.backend                  = dogpile.cache.null {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.backend_argument         = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.backend_expiration_time  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.config_prefix            = cache.oslo {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.debug_cache_backend      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.enable_retry_client      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.enable_socket_keepalive  = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.enabled                  = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.enforce_fips_mode        = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.expiration_time          = 600 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.hashclient_retry_attempts = 2 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_dead_retry      = 300 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_pool_maxsize    = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_sasl_enabled    = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.password                 = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.proxies                  = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.redis_db                 = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.redis_sentinel_service_name = mymaster {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.redis_server             = localhost:6379 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.retry_attempts           = 2 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.retry_delay              = 0.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81674) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.socket_keepalive_count   = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.socket_keepalive_idle    = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.socket_keepalive_interval = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.socket_timeout           = 1.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.tls_allowed_ciphers      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: WARNING cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.tls_cafile               = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: WARNING cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.tls_certfile             = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.tls_enabled              = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.tls_keyfile              = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cache.username                 = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] coordination.backend_url       = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Running cmd (subprocess): mount.quobyte {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.asyncio_connection    = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.asyncio_slave_connection = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.backend               = sqlalchemy {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.connection            = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.connection_debug      = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.connection_parameters =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.connection_recycle_time = 3600 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.connection_trace      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.db_inc_retry_interval = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.db_max_retries        = 20 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.db_max_retry_interval = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.db_retry_interval     = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.max_overflow          = 50 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.max_pool_size         = 5 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.max_retries           = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.mysql_wsrep_sync_wait = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.pool_timeout          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.retry_interval        = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.slave_connection      = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.sqlite_synchronous    = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.synchronous_reader    = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] database.use_db_reconnect      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.connection_string     = messaging:// {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.enabled               = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.es_doc_type           = notification {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.es_scroll_size        = 10000 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.es_scroll_time        = 2m {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.filter_error_trace    = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.hmac_keys             = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.sentinel_service_name = mymaster {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.socket_timeout        = 0.1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.trace_requests        = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler.trace_sqlalchemy      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler_jaeger.process_tags   = {} {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler_jaeger.service_name_prefix = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] profiler_otlp.service_name_prefix = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.enforce_new_defaults = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: WARNING oslo_config.cfg [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.enforce_scope      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.policy_default_rule = default {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.policy_file        = policy.yaml {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.group          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.helper_command = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] privsep_osbrick.user           = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.group         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.helper_command = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] cinder_sys_admin.user          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.auth_section      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.auth_type         = password {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.cafile            = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.certfile          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.collect_timing    = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.insecure          = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.keyfile           = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.send_service_user_token = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.split_loggers     = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] service_user.timeout           = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.auth_section            = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.auth_type               = password {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.certfile                = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.collect_timing          = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.insecure                = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.keyfile                 = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.region_name             = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.split_loggers           = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] glance.timeout                 = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.backend_availability_zone = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.chap_password = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.chap_username =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.disk_geometry = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.driver_client_cert = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.driver_client_cert_key = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.driver_data_namespace = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.driver_use_ssl = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.enable_unsupported_driver = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.extra_capabilities = {} {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.filter_function = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.goodness_function = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.iscsi_target_flags =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.iscsi_write_cache = on {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.iser_helper   = tgtadm {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.iser_port     = 3260 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_host      =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_login     = admin {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_mount_options = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_password  = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_private_key =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_share_path =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.num_shell_tries = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.nvmet_port_id = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_client_cfg = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.quobyte_volume_url = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.replication_device = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.report_discard_supported = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.reserved_percentage = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.scst_target_driver = iscsi {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.scst_target_iqn_name = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.storage_protocol = iSCSI {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.target_helper = tgtadm {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.target_port   = 3260 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.target_protocol = iscsi {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.trace_flags   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.unique_fqdn_network = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.use_chap_auth = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_backend_name = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_clear  = zero {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_clear_ionice = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_clear_size = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_reports.file_event_handler = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_reports.log_dir           = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.backend_availability_zone = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.backend_host         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.chap_password        = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.chap_username        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.chiscsi_conf         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.disk_geometry        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.driver_client_cert   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.driver_client_cert_key = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.driver_data_namespace = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.driver_use_ssl       = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.extra_capabilities   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.filter_function      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.goodness_function    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.iser_helper          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.iser_ip_address      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.iser_port            = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.iser_target_prefix   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_host             = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_login            = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_mount_options    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_password         = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_private_key      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_share_path       = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_ssh_port         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.num_shell_tries      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.nvmet_port_id        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.replication_device   = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.report_discard_supported = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.reserved_percentage  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.scst_target_driver   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.storage_protocol     = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.target_helper        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.target_ip_address    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.target_port          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.target_prefix        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.target_protocol      = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.trace_flags          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.use_chap_auth        = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_clear         = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_clear_size    = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] QuobyteHD.volumes_dir          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack quobyte-client[81678]: Reading configuration file: /etc/quobyte/client.cfg
Apr 13 11:16:05 devstack quobyte-client[81678]: Invalid parameters found, error: missing mount point.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack quobyte-client[81678]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 13 11:16:05 devstack quobyte-client[81678]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.ssl      = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_notifications.driver = [] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_notifications.retry = -1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] oslo_messaging_notifications.transport_url = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] key_manager.fixed_key          = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.barbican_api_version  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.barbican_endpoint     = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.barbican_endpoint_type = public {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.barbican_region_name  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.cafile                = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.certfile              = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.collect_timing        = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.insecure              = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.keyfile               = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.number_of_retries     = 60 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.retry_delay           = 1 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.send_service_user_token = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.split_loggers         = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.timeout               = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.verify_ssl            = True {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican.verify_ssl_path       = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.auth_section = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.auth_type = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.cafile   = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.certfile = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.collect_timing = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.insecure = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.keyfile  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.split_loggers = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] barbican_service_user.timeout  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.approle_role_id          = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.approle_secret_id        = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.kv_mountpoint            = secret {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.kv_path                  = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.kv_version               = 2 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.namespace                = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.root_token_id            = **** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.ssl_ca_crt_file          = None {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.timeout                  = 60.0 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=81674) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.use_ssl                  = False {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:05 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] ******************************************************************************** {{(pid=81560) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 11:16:05 devstack cinder-volume[81674]: INFO cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d ...
Apr 13 11:16:05 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f -c /etc/quobyte/client-cinder.cfg {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:05 devstack sudo[81679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f -c /etc/quobyte/client-cinder.cfg
Apr 13 11:16:05 devstack sudo[81679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:06 devstack sudo[81679]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.557s {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:06 devstack cinder-volume[81674]: INFO cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d succeeded
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=81674) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.564s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:06 devstack sudo[81754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:06 devstack sudo[81754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:06 devstack sudo[81754]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.425s {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:06 devstack cinder-volume[81674]: INFO cinder.volume.driver [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG cinder.volume.driver [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81674) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81674) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG dbcounter [-] [81674] Writer thread running {{(pid=81674) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG cinder.db.sqlalchemy.api [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Building query based on filter {{(pid=81674) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG cinder.image.image_utils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81674) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 11:16:06 devstack cinder-volume[81674]: INFO cinder.keymgr.migration [None req-b91048d1-2025-491b-9703-e912cfc9d55d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=81674) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=81674) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:06 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:06 devstack sudo[81757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:06 devstack sudo[81757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:07 devstack sudo[81757]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.409s {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG cinder.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Notifying Schedulers of capabilities ... {{(pid=81674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:16:07 devstack cinder-volume[81674]: INFO cinder.volume.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Driver initialization completed successfully.
Apr 13 11:16:07 devstack cinder-volume[81674]: INFO cinder.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Initiating service 3 cleanup
Apr 13 11:16:07 devstack cinder-volume[81674]: INFO cinder.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Service 3 cleanup completed.
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG cinder.service [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Creating RPC server for service cinder-volume {{(pid=81674) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG cinder.service [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81674) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 11:16:07 devstack cinder-volume[81674]: INFO cinder.volume.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=81674) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=81674) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:07 devstack sudo[81763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:07 devstack sudo[81763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:07 devstack sudo[81763]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:07 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.395s {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:07 devstack cinder-volume[81674]: INFO cinder.volume.manager [None req-4e2de4aa-ecc6-4ee1-8f55-6bbd50213909 None None] Driver post RPC initialization completed successfully.
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=81674) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG cinder.volume.drivers.quobyte [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=81674) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81674) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:10 devstack sudo[81828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:10 devstack sudo[81828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:10 devstack sudo[81828]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG oslo_concurrency.processutils [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.408s {{(pid=81674) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:10 devstack cinder-volume[81674]: DEBUG cinder.manager [None req-c3596562-3182-4b9f-b9ea-41ce2d356d0b None None] Notifying Schedulers of capabilities ... {{(pid=81674) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:16:14 devstack cinder-volume[81560]: INFO oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Caught SIGTERM, stopping children
Apr 13 11:16:14 devstack cinder-volume[81560]: DEBUG oslo_concurrency.lockutils [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Acquiring lock "singleton_lock" {{(pid=81560) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:16:14 devstack cinder-volume[81560]: DEBUG oslo_concurrency.lockutils [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Acquired lock "singleton_lock" {{(pid=81560) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:16:14 devstack cinder-volume[81560]: DEBUG oslo_concurrency.lockutils [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Releasing lock "singleton_lock" {{(pid=81560) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:16:14 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Stop services. {{(pid=81560) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 11:16:14 devstack cinder-volume[81560]: DEBUG oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Killing children. {{(pid=81560) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 11:16:14 devstack cinder-volume[81560]: INFO oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Waiting on 1 children to exit
Apr 13 11:16:15 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Acquiring lock "singleton_lock" {{(pid=81674) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:16:15 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Acquired lock "singleton_lock" {{(pid=81674) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:16:15 devstack cinder-volume[81674]: DEBUG oslo_concurrency.lockutils [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Releasing lock "singleton_lock" {{(pid=81674) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:16:15 devstack cinder-volume[81674]: WARNING amqp [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 11:16:15 devstack cinder-volume[81674]: WARNING amqp [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 11:16:15 devstack cinder-volume[81560]: INFO oslo_service.backend._eventlet.service [None req-36acefb4-672c-495b-8664-624f8cf8615f None None] Child 81674 exited with status 0
Apr 13 11:16:15 devstack cinder-volume[81938]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 11:16:15 devstack cinder-volume[81938]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 11:16:15 devstack cinder-volume[81938]: we strongly recommend against using it for new projects.
Apr 13 11:16:15 devstack cinder-volume[81938]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 11:16:15 devstack cinder-volume[81938]: framework.  For more detail see
Apr 13 11:16:15 devstack cinder-volume[81938]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 11:16:15 devstack cinder-volume[81938]:   import eventlet  # noqa
Apr 13 11:16:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81938) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 11:16:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81938) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 11:16:17 devstack cinder-volume[81938]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81938) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 11:16:18 devstack cinder-volume[81938]: INFO dbcounter [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Registered counter for database cinder
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_db.sqlalchemy.engines [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81938) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writer thread running {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 11:16:18 devstack cinder-volume[81938]: INFO cinder.rpc [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 11:16:18 devstack cinder-volume[81938]: INFO cinder.rpc [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_db.sqlalchemy.engines [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81938) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:18 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Determined volume DB was empty at startup.
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG cinder.volume.manager [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81938) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 11:16:18 devstack cinder-volume[81938]: WARNING stevedore.named [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 11:16:18 devstack cinder-volume[81938]: WARNING castellan.key_manager [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:16:18 devstack cinder-volume[81938]: WARNING cinder.keymgr.conf_key_mgr [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 11:16:18 devstack cinder-volume[81938]: INFO cinder.volume.manager [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_db.sqlalchemy.engines [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81938) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:18 devstack cinder-volume[81938]: INFO oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Starting 1 workers
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Started child 82099 {{(pid=81938) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Full set of CONF: {{(pid=81938) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] ******************************************************************************** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Configuration options gathered from: {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] ================================================================================ {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] allow_availability_zone_fallback = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] allow_compression_on_image_upload = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] allowed_direct_url_schemes     = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] api_rate_limit                 = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] auth_strategy                  = keystone {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_availability_zone      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_host                   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_name                   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_stats_polling_interval = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backup_api_class               = cinder.backup.api.API {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backup_name_template           = backup-%s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backup_use_same_host           = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backup_use_temp_snapshot       = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] chap_password                  = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] chap_username                  =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_internal_tenant_project_id = e53a209b178c4079aa448f7a1179ca07 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_internal_tenant_user_id = e40bfda3b6984bfea6e6a4e6569ba4e7 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cluster                        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] compression_format             = gzip {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] compute_api_class              = cinder.compute.nova.API {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] config_dir                     = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] config_source                  = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] control_exchange               = openstack {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] debug                          = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] default_availability_zone      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] default_group_type             = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] default_volume_type            = QuobyteHD {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] disk_geometry                  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] driver_client_cert             = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] driver_client_cert_key         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] driver_data_namespace          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] driver_ssl_cert_path           = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] driver_ssl_cert_verify         = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] driver_use_ssl                 = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] enable_new_services            = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] enable_unsupported_driver      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] enabled_backends               = ['QuobyteHD'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] enforce_multipath_for_image_xfer = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] filter_function                = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_api_insecure            = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_api_ssl_compression     = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_ca_certificates_file    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_catalog_info            = image:glance:publicURL {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_certfile                = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_keyfile                 = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_num_retries             = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance_request_timeout         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] goodness_function              = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] graceful_shutdown_timeout      = 5 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[82099]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] group_api_class                = cinder.group.api.API {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] host                           = devstack {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_compress_on_upload       = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_conversion_address_space_limit = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_conversion_cpu_limit     = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_conversion_disable       = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_upload_use_cinder_backend = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_upload_use_internal_tenant = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_volume_cache_enabled     = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_volume_cache_max_count   = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] image_volume_cache_max_size_gb = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] init_host_max_objects_retrieval = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] instance_format                = [instance: %(uuid)s]  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] iscsi_target_flags             =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] iscsi_write_cache              = on {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] iser_helper                    = tgtadm {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] iser_ip_address                = 192.168.122.135 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] iser_port                      = 3260 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_color                      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_config_append              = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_dir                        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_file                       = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_options                    = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_rotate_interval            = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_rotate_interval_type       = days {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] log_rotation_type              = none {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] max_age                        = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] max_logfile_count              = 30 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] max_logfile_size_mb            = 200 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] max_over_subscription_ratio    = 20.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] message_reap_interval          = 86400 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] message_ttl                    = 2592000 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] migration_create_volume_timeout_secs = 300 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] monkey_patch                   = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] monkey_patch_modules           = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] my_ip                          = 192.168.122.135 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] no_snapshot_gb_quota           = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] num_iser_scan_tries            = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] num_shell_tries                = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] num_volume_device_scan_tries   = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] nvmeof_conn_info_version       = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] nvmet_ns_id                    = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] nvmet_port_id                  = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_max_limit                = 1000 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_volume_ext_list          = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_volume_listen_port       = 8776 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_volume_use_ssl           = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] osapi_volume_workers           = 2 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] per_volume_size_limit          = -1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] periodic_fuzzy_delay           = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] periodic_interval              = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] public_endpoint                = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] publish_errors                 = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_backup_gigabytes         = 1000 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_backups                  = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_gigabytes                = 1000 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_groups                   = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_snapshots                = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] quota_volumes                  = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] rate_limit_burst               = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] rate_limit_except_level        = CRITICAL {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] rate_limit_interval            = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] reinit_driver_count            = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] replication_device             = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] report_discard_supported       = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] report_interval                = 120 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] reservation_clean_interval     = 86400 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] reservation_expire             = 86400 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] reserved_image_namespaces      = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] reserved_percentage            = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] rpc_response_timeout           = 120 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] run_external_periodic_tasks    = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] scst_target_driver             = iscsi {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] scst_target_iqn_name           = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_down_time              = 720 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] shell_completion               = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] snapshot_name_template         = snapshot-%s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] split_loggers                  = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] state_path                     = /opt/stack/data/cinder {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] storage_availability_zone      = nova {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] storage_protocol               = iSCSI {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] syslog_log_facility            = LOG_USER {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] target_helper                  = lioadm {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] target_ip_address              = 192.168.122.135 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] target_port                    = 3260 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] target_protocol                = iscsi {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] target_secondary_ip_addresses  = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] trace_flags                    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] transport_url                  = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] until_refresh                  = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_chap_auth                  = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_default_quota_class        = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_journal                    = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_json                       = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_multipath_for_image_xfer   = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_stderr                     = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] use_syslog                     = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] verify_glance_signatures       = enabled {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_api_class               = cinder.volume.api.API {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_backend_name            = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_clear                   = zero {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_clear_ionice            = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_clear_size              = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_copy_bps_limit          = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_dd_blocksize            = 1M {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_name_template           = volume-%s {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_service_inithost_offload = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volume_usage_audit_period      = month {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] zoning_mode                    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_concurrency.disable_process_locking = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.admin_password = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.admin_token = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.admin_user  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_port   = 35357 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_protocol = https {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_section = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_type   = password {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_uri    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.auth_version = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.cache       = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.certfile    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.identity_uri = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.include_service_catalog = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.insecure    = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.interface   = public {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.keyfile     = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_password =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcache_username =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.region_name = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.service_type = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.backend                  = dogpile.cache.null {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.backend_argument         = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.backend_expiration_time  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.config_prefix            = cache.oslo {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.debug_cache_backend      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.enable_retry_client      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.enable_socket_keepalive  = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.enabled                  = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.enforce_fips_mode        = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.expiration_time          = 600 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.hashclient_retry_attempts = 2 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_dead_retry      = 300 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_pool_maxsize    = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_sasl_enabled    = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.password                 = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.proxies                  = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.redis_db                 = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.redis_server             = localhost:6379 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.retry_attempts           = 2 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.retry_delay              = 0.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.socket_keepalive_count   = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.socket_keepalive_idle    = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.socket_keepalive_interval = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.socket_timeout           = 1.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.tls_allowed_ciphers      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.tls_cafile               = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.tls_certfile             = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.tls_enabled              = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.tls_keyfile              = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cache.username                 = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] coordination.backend_url       = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.asyncio_connection    = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.asyncio_slave_connection = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.backend               = sqlalchemy {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.connection            = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.connection_debug      = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.connection_parameters =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.connection_recycle_time = 3600 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.connection_trace      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.db_inc_retry_interval = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82099) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.db_max_retries        = 20 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.db_max_retry_interval = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.db_retry_interval     = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.max_overflow          = 50 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.max_pool_size         = 5 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.max_retries           = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.mysql_wsrep_sync_wait = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.pool_timeout          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.retry_interval        = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.slave_connection      = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.sqlite_synchronous    = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.synchronous_reader    = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] database.use_db_reconnect      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.connection_string     = messaging:// {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.enabled               = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.es_doc_type           = notification {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.es_scroll_size        = 10000 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.es_scroll_time        = 2m {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.filter_error_trace    = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.hmac_keys             = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.sentinel_service_name = mymaster {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.socket_timeout        = 0.1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.trace_requests        = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler.trace_sqlalchemy      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler_jaeger.process_tags   = {} {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler_jaeger.service_name_prefix = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] profiler_otlp.service_name_prefix = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.enforce_new_defaults = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: WARNING oslo_config.cfg [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.enforce_scope      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.policy_default_rule = default {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.policy_file        = policy.yaml {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.group          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.helper_command = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] privsep_osbrick.user           = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.group         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.helper_command = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] cinder_sys_admin.user          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.auth_section      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.auth_type         = password {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.cafile            = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.certfile          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.collect_timing    = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.insecure          = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.keyfile           = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.send_service_user_token = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.split_loggers     = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] service_user.timeout           = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.auth_section            = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.auth_type               = password {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.certfile                = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.collect_timing          = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.insecure                = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.keyfile                 = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.region_name             = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.split_loggers           = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] glance.timeout                 = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.backend_availability_zone = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.chap_password = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.chap_username =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.disk_geometry = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.driver_client_cert = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.driver_client_cert_key = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.driver_data_namespace = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.driver_use_ssl = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.extra_capabilities = {} {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.filter_function = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.goodness_function = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.iscsi_target_flags =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.iscsi_write_cache = on {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.iser_helper   = tgtadm {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.iser_port     = 3260 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_host      =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_login     = admin {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_mount_options = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_password  = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_private_key =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_share_path =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.num_shell_tries = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.quobyte_volume_url = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.replication_device = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.report_discard_supported = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.reserved_percentage = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.target_helper = tgtadm {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.target_port   = 3260 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.target_protocol = iscsi {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.trace_flags   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.unique_fqdn_network = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.use_chap_auth = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_backend_name = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_clear  = zero {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_clear_ionice = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_clear_size = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_reports.file_event_handler = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_reports.log_dir           = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.backend_availability_zone = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.backend_host         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.chap_password        = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.chap_username        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.chiscsi_conf         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.disk_geometry        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.driver_client_cert   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.driver_data_namespace = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.driver_use_ssl       = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.extra_capabilities   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.filter_function      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.goodness_function    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.iser_helper          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.iser_ip_address      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.iser_port            = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.iser_target_prefix   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_host             = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_login            = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_mount_options    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_password         = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_private_key      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_share_path       = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_ssh_port         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.num_shell_tries      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.nvmet_port_id        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.replication_device   = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.report_discard_supported = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.reserved_percentage  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.scst_target_driver   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.storage_protocol     = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.target_helper        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.target_ip_address    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.target_port          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.target_prefix        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.target_protocol      = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.trace_flags          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.use_chap_auth        = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_clear         = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_clear_size    = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] QuobyteHD.volumes_dir          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.ssl      = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_notifications.driver = [] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_notifications.retry = -1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] key_manager.fixed_key          = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.barbican_api_version  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.barbican_endpoint     = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.barbican_endpoint_type = public {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.barbican_region_name  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.cafile                = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.certfile              = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.collect_timing        = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.insecure              = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.keyfile               = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.number_of_retries     = 60 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.retry_delay           = 1 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.send_service_user_token = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.split_loggers         = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.timeout               = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.verify_ssl            = True {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican.verify_ssl_path       = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.auth_section = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.auth_type = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.cafile   = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.certfile = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.collect_timing = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.insecure = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.keyfile  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.split_loggers = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] barbican_service_user.timeout  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.approle_role_id          = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.approle_secret_id        = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.kv_mountpoint            = secret {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.kv_path                  = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.kv_version               = 2 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.namespace                = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.root_token_id            = **** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.ssl_ca_crt_file          = None {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.timeout                  = 60.0 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.use_ssl                  = False {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 11:16:18 devstack cinder-volume[81938]: DEBUG oslo_service.backend._eventlet.service [None req-2a985e6b-5a0c-4eaf-bc5e-afb9b4318a8b None None] ******************************************************************************** {{(pid=81938) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82099) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 11:16:18 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 11:16:18 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Running cmd (subprocess): mount.quobyte {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:18 devstack sudo[82148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:18 devstack sudo[82148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:19 devstack sudo[82148]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.611s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:19 devstack cinder-volume[82099]: INFO cinder.volume.driver [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG cinder.volume.driver [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82099) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG oslo_db.sqlalchemy.engines [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82099) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writer thread running {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG cinder.db.sqlalchemy.api [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Building query based on filter {{(pid=82099) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82099) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:19 devstack cinder-volume[82099]: INFO cinder.keymgr.migration [None req-5c691c9c-1aba-47f3-8356-4a19f9467fd1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 11:16:19 devstack sudo[82176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:19 devstack sudo[82176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:20 devstack sudo[82176]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.517s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:16:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Driver initialization completed successfully.
Apr 13 11:16:20 devstack cinder-volume[82099]: INFO cinder.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Initiating service 3 cleanup
Apr 13 11:16:20 devstack cinder-volume[82099]: INFO cinder.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Service 3 cleanup completed.
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG cinder.service [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Creating RPC server for service cinder-volume {{(pid=82099) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG cinder.service [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82099) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 11:16:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:16:20 devstack sudo[82187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:16:20 devstack sudo[82187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:16:20 devstack sudo[82187]: pam_unix(sudo:session): session closed for user root
Apr 13 11:16:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.412s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:16:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6816dc3f-4aab-415e-9aa7-9c5b800acedb None None] Driver post RPC initialization completed successfully.
Apr 13 11:16:28 devstack cinder-volume[81938]: DEBUG dbcounter [-] [81938] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:16:30 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:16:30 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=3 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:17:20 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:17:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Flow 'volume_create_manager' (957b5f1f-5619-4956-b22d-0ad3106a430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f943d3d8-c358-42bb-97ca-76038bd36789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f943d3d8-c358-42bb-97ca-76038bd36789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-722752142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0135f6d-b722-4417-99b1-d4a9e30af74a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b189aebbc4cf7902337b710c85e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:21Z,use_quota=True,user_id='5336d1de3440474588beedd633dad595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c6d337-0727-4ab5-afbd-e130debffbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c6d337-0727-4ab5-afbd-e130debffbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a261ad7-4007-42bf-943a-61be6da0595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a261ad7-4007-42bf-943a-61be6da0595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0135f6d-b722-4417-99b1-d4a9e30af74a', 'volume_name': 'volume-b0135f6d-b722-4417-99b1-d4a9e30af74a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b95f472-e99f-4f92-bf1b-c135003aa51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b95f472-e99f-4f92-bf1b-c135003aa51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dab42-e6e9-4504-a85f-38c8ff7a8ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:21 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Volume b0135f6d-b722-4417-99b1-d4a9e30af74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0135f6d-b722-4417-99b1-d4a9e30af74a', 'volume_size': 1}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-722752142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0135f6d-b722-4417-99b1-d4a9e30af74a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b189aebbc4cf7902337b710c85e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:21Z,use_quota=True,user_id='5336d1de3440474588beedd633dad595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Creating volume b0135f6d-b722-4417-99b1-d4a9e30af74a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:17:21 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:17:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:21 devstack sudo[82662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a 1073741824
Apr 13 11:17:21 devstack sudo[82662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:23 devstack sudo[82662]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a 1073741824" returned: 0 in 2.376s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:23 devstack sudo[83001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a
Apr 13 11:17:23 devstack sudo[83001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Flow 'volume_create_manager' (a542b613-3773-4886-9891-2560be17515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb029709-6055-4c11-a1e4-868cf6a178a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb029709-6055-4c11-a1e4-868cf6a178a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1169492388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2c4590-74d8-4dd1-960d-220326a9906a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da065f203114beba90e08a7d1f0ada1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:24Z,use_quota=True,user_id='b3bf3d9110e842379d77c28e388a768f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5c8a8-9abc-4777-8a59-6ac5382479dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5c8a8-9abc-4777-8a59-6ac5382479dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ba1afb-4fc6-41ed-90dd-61d297f83907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ba1afb-4fc6-41ed-90dd-61d297f83907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2c4590-74d8-4dd1-960d-220326a9906a', 'volume_name': 'volume-be2c4590-74d8-4dd1-960d-220326a9906a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f42f5fc-4df3-47d2-9dc7-b49e47714784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f42f5fc-4df3-47d2-9dc7-b49e47714784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dbc956-4c7d-47bf-8622-667e1572b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:23 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Volume be2c4590-74d8-4dd1-960d-220326a9906a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2c4590-74d8-4dd1-960d-220326a9906a', 'volume_size': 1}
Apr 13 11:17:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:24 devstack sudo[83001]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a" returned: 0 in 1.125s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] <== create_volume: return (3618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.619s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1169492388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2c4590-74d8-4dd1-960d-220326a9906a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da065f203114beba90e08a7d1f0ada1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:24Z,use_quota=True,user_id='b3bf3d9110e842379d77c28e388a768f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Creating volume be2c4590-74d8-4dd1-960d-220326a9906a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:17:24 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dab42-e6e9-4504-a85f-38c8ff7a8ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0135f6d-b722-4417-99b1-d4a9e30af74a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4ff3b5-1cbf-450c-83a0-7a6a9c407059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:24 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Volume volume-b0135f6d-b722-4417-99b1-d4a9e30af74a (b0135f6d-b722-4417-99b1-d4a9e30af74a): created successfully
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4ff3b5-1cbf-450c-83a0-7a6a9c407059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Flow 'volume_create_manager' (957b5f1f-5619-4956-b22d-0ad3106a430f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:24 devstack sudo[83004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a 1073741824
Apr 13 11:17:24 devstack sudo[83004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:24 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9b419e72-85e1-42a6-9731-863bc4c03ba1 tempest-VolumesTestJSON-246863362 None] Created volume successfully.
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Flow 'volume_create_manager' (b29de7bf-19d9-49d9-a977-b753555527d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa29392-798a-4e21-a9a5-caa6e4746ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa29392-798a-4e21-a9a5-caa6e4746ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1959106773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910ed9fd-2ef8-42ac-9906-2bcc52f0aac5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b189aebbc4cf7902337b710c85e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:26Z,use_quota=True,user_id='5336d1de3440474588beedd633dad595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcd89d8-1ba5-4099-a9a6-da1c602a1cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcd89d8-1ba5-4099-a9a6-da1c602a1cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce607cd-6d34-442e-a253-35e70fb0d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce607cd-6d34-442e-a253-35e70fb0d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910ed9fd-2ef8-42ac-9906-2bcc52f0aac5', 'volume_name': 'volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4be3fd8-b356-4861-a4cb-412644c2cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4be3fd8-b356-4861-a4cb-412644c2cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5af682f-3f59-40da-b541-ca8639b95075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:26 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Volume 910ed9fd-2ef8-42ac-9906-2bcc52f0aac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5', 'volume_size': 1}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:26 devstack sudo[83004]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a 1073741824" returned: 0 in 1.915s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:26 devstack sudo[83032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a
Apr 13 11:17:26 devstack sudo[83032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:27 devstack sudo[83032]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a" returned: 0 in 0.898s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] <== create_volume: return (2880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.889s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1959106773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910ed9fd-2ef8-42ac-9906-2bcc52f0aac5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b189aebbc4cf7902337b710c85e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:26Z,use_quota=True,user_id='5336d1de3440474588beedd633dad595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Creating volume 910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:17:27 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dbc956-4c7d-47bf-8622-667e1572b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2c4590-74d8-4dd1-960d-220326a9906a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81c72a3-7009-45fd-a6be-2a393ded35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:27 devstack sudo[83040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 1073741824
Apr 13 11:17:27 devstack sudo[83040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:27 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Volume volume-be2c4590-74d8-4dd1-960d-220326a9906a (be2c4590-74d8-4dd1-960d-220326a9906a): created successfully
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81c72a3-7009-45fd-a6be-2a393ded35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Flow 'volume_create_manager' (a542b613-3773-4886-9891-2560be17515c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1a791a95-024a-40dd-9fc1-5d66841110e4 tempest-VolumesAdminNegativeTest-586483679 None] Created volume successfully.
Apr 13 11:17:28 devstack sudo[83040]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 1073741824" returned: 0 in 1.402s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:29 devstack sudo[83050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5
Apr 13 11:17:29 devstack sudo[83050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Acquiring lock "cinder-be2c4590-74d8-4dd1-960d-220326a9906a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Lock "cinder-be2c4590-74d8-4dd1-960d-220326a9906a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Acquiring lock "cinder-quobyte-be2c4590-74d8-4dd1-960d-220326a9906a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Lock "cinder-quobyte-be2c4590-74d8-4dd1-960d-220326a9906a" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:29 devstack cinder-volume[82099]: INFO oslo.privsep.daemon [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpl5eum2cd/privsep.sock']
Apr 13 11:17:29 devstack sudo[83052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpl5eum2cd/privsep.sock
Apr 13 11:17:29 devstack sudo[83052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:30 devstack sudo[83050]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5" returned: 0 in 1.259s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] <== create_volume: return (2709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.713s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5af682f-3f59-40da-b541-ca8639b95075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18bf29a-aa37-4256-b889-c94ce1ed573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Volume volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 (910ed9fd-2ef8-42ac-9906-2bcc52f0aac5): created successfully
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18bf29a-aa37-4256-b889-c94ce1ed573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Flow 'volume_create_manager' (b29de7bf-19d9-49d9-a977-b753555527d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-562e22bd-c77c-4fd5-a7cb-01fe19ee5de1 tempest-VolumesTestJSON-246863362 None] Created volume successfully.
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 11:17:30 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 11:17:31 devstack cinder-volume[82099]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Flow 'volume_create_manager' (44f7550b-7ba2-43d0-87b9-8545d12998fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1b51d3-db67-4bcd-9675-9897567a132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1b51d3-db67-4bcd-9675-9897567a132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1930019403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217e363b-76b5-45f3-8a49-7bb792ef5d9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b189aebbc4cf7902337b710c85e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:32Z,use_quota=True,user_id='5336d1de3440474588beedd633dad595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ee35aa-422f-4ed2-bf59-0add2b0b1340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ee35aa-422f-4ed2-bf59-0add2b0b1340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfeaac8-0bf8-4c0e-8c08-8c70da81f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfeaac8-0bf8-4c0e-8c08-8c70da81f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217e363b-76b5-45f3-8a49-7bb792ef5d9b', 'volume_name': 'volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8af6b01-3e7a-4d3b-8d76-17e46c4036ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8af6b01-3e7a-4d3b-8d76-17e46c4036ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2a5158-b375-4cb1-849b-66c4da2cabae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:31 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Volume 217e363b-76b5-45f3-8a49-7bb792ef5d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b', 'volume_size': 1}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1930019403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217e363b-76b5-45f3-8a49-7bb792ef5d9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b189aebbc4cf7902337b710c85e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:32Z,use_quota=True,user_id='5336d1de3440474588beedd633dad595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Creating volume 217e363b-76b5-45f3-8a49-7bb792ef5d9b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:17:31 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:17:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:31 devstack sudo[83087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b 1073741824
Apr 13 11:17:31 devstack sudo[83087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:32 devstack sudo[83052]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:32 devstack cinder-volume[82099]: INFO oslo.privsep.daemon [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Spawned new privsep daemon via rootwrap
Apr 13 11:17:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Accepted privsep connection to /tmp/tmpl5eum2cd/privsep.sock {{(pid=82099) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 13 11:17:32 devstack cinder-volume[82099]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 11:17:32 devstack cinder-volume[82099]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 11:17:32 devstack cinder-volume[82099]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 11:17:32 devstack cinder-volume[82099]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83086
Apr 13 11:17:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d96bdd6-b735-4a50-83a0-6468f7491598]: (2,) {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d114ef-8182-4d8c-a19e-697be1fe5bad]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:32 devstack sudo[83090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a
Apr 13 11:17:32 devstack sudo[83090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:33 devstack sudo[83090]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a" returned: 0 in 1.037s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:33 devstack sudo[83102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a
Apr 13 11:17:33 devstack sudo[83102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:33 devstack sudo[83087]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b 1073741824" returned: 0 in 1.706s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:33 devstack sudo[83105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b
Apr 13 11:17:33 devstack sudo[83105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:34 devstack sudo[83105]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b" returned: 0 in 0.694s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] <== create_volume: return (2453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.455s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Flow 'volume_create_manager' (822e022d-b5a5-4019-87a8-0a60a4551af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ea16fb-391a-45f6-91ae-c9f52f1d413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:34 devstack sudo[83102]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ea16fb-391a-45f6-91ae-c9f52f1d413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1375391772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac47ab9d35e428ca33d746f0304cd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:34Z,use_quota=True,user_id='16f74eff356949378dea916cd455c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604dda21-c1da-4601-bc50-771338811048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604dda21-c1da-4601-bc50-771338811048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a56ab4-cae4-4108-9a1f-94abbd28e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a56ab4-cae4-4108-9a1f-94abbd28e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a', 'volume_name': 'volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e02276a-360c-4325-90b4-8dd6fa0c62ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e02276a-360c-4325-90b4-8dd6fa0c62ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10db967c-5f54-46ed-b99c-ada60717e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Volume eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a', 'volume_size': 1}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1375391772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac47ab9d35e428ca33d746f0304cd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:34Z,use_quota=True,user_id='16f74eff356949378dea916cd455c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Creating volume eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:17:34 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-be2c4590-74d8-4dd1-960d-220326a9906a" returned: 0 in 1.158s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:34 devstack sudo[83112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a 1073741824
Apr 13 11:17:34 devstack sudo[83112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Lock "cinder-quobyte-be2c4590-74d8-4dd1-960d-220326a9906a" released by "delete_volume" :: held 5.051s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:34 devstack cinder-volume[82099]: WARNING cinder.quota [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:17:34 devstack cinder-volume[82099]: WARNING cinder.quota [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2a5158-b375-4cb1-849b-66c4da2cabae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4bbca9-0dc2-4d18-94e4-73ea5ea4687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Created reservations ['1dfcc169-a17e-470d-a7e6-20567cb9467a', '877ec0d7-b163-48fa-b647-706622e4e602', 'a072818f-d924-4727-9575-c66f6d15b829', '2f17cdf0-de01-4e4f-bc37-84eee5f81b8e'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:17:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Volume volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b (217e363b-76b5-45f3-8a49-7bb792ef5d9b): created successfully
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4bbca9-0dc2-4d18-94e4-73ea5ea4687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Flow 'volume_create_manager' (44f7550b-7ba2-43d0-87b9-8545d12998fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a8c89e35-4436-4116-8817-1793b4ff05b7 tempest-VolumesTestJSON-246863362 None] Created volume successfully.
Apr 13 11:17:34 devstack sudo[83114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:17:34 devstack sudo[83114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:35 devstack sudo[83114]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.821s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:35 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:17:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Deleted volume successfully.
Apr 13 11:17:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-574ee01d-65c5-4d13-9a52-fec6355533bf tempest-VolumesAdminNegativeTest-586483679 None] Lock "cinder-be2c4590-74d8-4dd1-960d-220326a9906a-delete_volume" released by "delete_volume" :: held 6.195s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:35 devstack sudo[83112]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a 1073741824" returned: 0 in 1.355s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:35 devstack sudo[83121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a
Apr 13 11:17:35 devstack sudo[83121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Acquiring lock "cinder-217e363b-76b5-45f3-8a49-7bb792ef5d9b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Lock "cinder-217e363b-76b5-45f3-8a49-7bb792ef5d9b-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Acquiring lock "cinder-quobyte-217e363b-76b5-45f3-8a49-7bb792ef5d9b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Lock "cinder-quobyte-217e363b-76b5-45f3-8a49-7bb792ef5d9b" acquired by "delete_volume" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[14621641-b4f3-414b-82b2-bdef67884d0b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:36 devstack sudo[83121]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a" returned: 0 in 1.058s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] <== create_volume: return (2467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.470s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10db967c-5f54-46ed-b99c-ada60717e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e14403d-9dcb-4f92-9f0b-1009e26ea0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Volume volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a (eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a): created successfully
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e14403d-9dcb-4f92-9f0b-1009e26ea0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Flow 'volume_create_manager' (822e022d-b5a5-4019-87a8-0a60a4551af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8d1ac91c-7d91-4aef-aefa-50978c91fbe6 tempest-ServerRescueNegativeTestJSON-193706527 None] Created volume successfully.
Apr 13 11:17:36 devstack sudo[83150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b
Apr 13 11:17:36 devstack sudo[83150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:37 devstack sudo[83150]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b" returned: 0 in 1.044s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:37 devstack sudo[83163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b
Apr 13 11:17:37 devstack sudo[83163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:38 devstack sudo[83163]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-217e363b-76b5-45f3-8a49-7bb792ef5d9b" returned: 0 in 1.159s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Lock "cinder-quobyte-217e363b-76b5-45f3-8a49-7bb792ef5d9b" released by "delete_volume" :: held 2.289s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Created reservations ['5ccff4a5-bd77-4455-94d6-121c2df0b3fb', 'be54729f-161e-474f-96ca-fe6468a2a4d7', '733386ff-d129-4e17-830f-2b7ad5641f66', 'ea278e8c-3d06-4456-a67f-5496ec891f2e'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:39 devstack sudo[83171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:17:39 devstack sudo[83171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:40 devstack sudo[83171]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.939s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:17:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Deleted volume successfully.
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b1fb4894-f138-42b9-99d8-6366a3313e5a tempest-VolumesTestJSON-246863362 None] Lock "cinder-217e363b-76b5-45f3-8a49-7bb792ef5d9b-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Acquiring lock "cinder-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Lock "cinder-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Acquiring lock "cinder-quobyte-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Lock "cinder-quobyte-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5" acquired by "delete_volume" :: waited 0.019s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[81814e0a-5a2a-4d9f-b610-0b23526d85af]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:40 devstack sudo[83186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5
Apr 13 11:17:40 devstack sudo[83186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:40 devstack sudo[83186]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5" returned: 0 in 0.609s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:40 devstack sudo[83196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5
Apr 13 11:17:41 devstack sudo[83196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:41 devstack sudo[83196]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5" returned: 0 in 0.609s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Lock "cinder-quobyte-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5" released by "delete_volume" :: held 1.265s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Created reservations ['d954434a-af5a-41d0-beca-5869a6268cdf', 'bbd7d255-ecd6-4fd6-8b04-7818ee50e8c5', 'a934e35b-96d9-4371-9515-3fa0fc122b77', '9a50499a-efd2-4bd3-8d4d-c132c1b0d170'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:41 devstack sudo[83200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:17:41 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:42 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.554s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:17:42 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Deleted volume successfully.
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-181073a5-7f87-4477-8f7c-76e799964c52 tempest-VolumesTestJSON-246863362 None] Lock "cinder-910ed9fd-2ef8-42ac-9906-2bcc52f0aac5-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Acquiring lock "cinder-b0135f6d-b722-4417-99b1-d4a9e30af74a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Lock "cinder-b0135f6d-b722-4417-99b1-d4a9e30af74a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Acquiring lock "cinder-quobyte-b0135f6d-b722-4417-99b1-d4a9e30af74a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Lock "cinder-quobyte-b0135f6d-b722-4417-99b1-d4a9e30af74a" acquired by "delete_volume" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec90a5fa-1598-434a-ae24-efa88c17fbee]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:42 devstack sudo[83230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a
Apr 13 11:17:42 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:43 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a" returned: 0 in 0.522s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:43 devstack sudo[83241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a
Apr 13 11:17:43 devstack sudo[83241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:43 devstack sudo[83241]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b0135f6d-b722-4417-99b1-d4a9e30af74a" returned: 0 in 0.539s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Lock "cinder-quobyte-b0135f6d-b722-4417-99b1-d4a9e30af74a" released by "delete_volume" :: held 1.088s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Created reservations ['379430c6-20d3-4169-9951-ba8cddc868ee', '4fee3ac6-4f22-4847-9532-dad123077d19', '10c82961-ba38-49f4-b2f4-ca4e27d3c691', 'e6f6125f-e554-4938-bc56-5373662dad96'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:43 devstack sudo[83251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:17:43 devstack sudo[83251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:44 devstack sudo[83251]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.450s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:44 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:17:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Deleted volume successfully.
Apr 13 11:17:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d4842174-e7e1-4211-a696-8890c7e731ad tempest-VolumesTestJSON-246863362 None] Lock "cinder-b0135f6d-b722-4417-99b1-d4a9e30af74a-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f6c13e40-301b-441b-9458-4e7735e9d3ef tempest-GroupSnapshotsV319Test-1683947689 None] Group tempest-GroupSnapshotsV319Test-Group-1868664227: creating
Apr 13 11:17:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f6c13e40-301b-441b-9458-4e7735e9d3ef tempest-GroupSnapshotsV319Test-1683947689 None] Group tempest-GroupSnapshotsV319Test-Group-1868664227: created successfully
Apr 13 11:17:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f6c13e40-301b-441b-9458-4e7735e9d3ef tempest-GroupSnapshotsV319Test-1683947689 None] Create group completed successfully.
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Flow 'volume_create_manager' (6f7e4f50-a179-4b13-878e-73d1f2d13401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9b68b5-36a5-4ab1-89fc-c9fa5abec942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9b68b5-36a5-4ab1-89fc-c9fa5abec942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-736902419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ca7b2cbb-2cbc-4a72-92c7-10e207faa654,host='devstack@QuobyteHD#QuobyteHD',id=722493d7-40ea-4300-83f0-3e209cb5c1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aef256a15a24af2bee6781d7010df21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:52Z,use_quota=True,user_id='d7fb378c2acb453ebe88ca00541649aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2148553-b561-4707-87f1-1c00e27f7ed8),volume_type_id=a2148553-b561-4707-87f1-1c00e27f7ed8)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6946c5-f8e8-4d8b-9e0a-e52acaef6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6946c5-f8e8-4d8b-9e0a-e52acaef6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6ab5eb-c984-49ae-a5a2-fa1f7fb9a9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6ab5eb-c984-49ae-a5a2-fa1f7fb9a9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722493d7-40ea-4300-83f0-3e209cb5c1ac', 'volume_name': 'volume-722493d7-40ea-4300-83f0-3e209cb5c1ac', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b237e-418e-4755-9ae4-30207f7a811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b237e-418e-4755-9ae4-30207f7a811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea8e5b2-b78f-4f40-8bf6-af57a8368713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:52 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Volume 722493d7-40ea-4300-83f0-3e209cb5c1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722493d7-40ea-4300-83f0-3e209cb5c1ac', 'volume_size': 1}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ca7b2cbb-2cbc-4a72-92c7-10e207faa654,created_at=2026-04-13T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-736902419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ca7b2cbb-2cbc-4a72-92c7-10e207faa654,host='devstack@QuobyteHD#QuobyteHD',id=722493d7-40ea-4300-83f0-3e209cb5c1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aef256a15a24af2bee6781d7010df21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:17:52Z,use_quota=True,user_id='d7fb378c2acb453ebe88ca00541649aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2148553-b561-4707-87f1-1c00e27f7ed8),volume_type_id=a2148553-b561-4707-87f1-1c00e27f7ed8)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Creating volume 722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:17:52 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:17:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:52 devstack sudo[83329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac 1073741824
Apr 13 11:17:52 devstack sudo[83329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:53 devstack sudo[83329]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac 1073741824" returned: 0 in 0.822s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:53 devstack sudo[83339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac
Apr 13 11:17:53 devstack sudo[83339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:54 devstack sudo[83339]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac" returned: 0 in 1.191s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea8e5b2-b78f-4f40-8bf6-af57a8368713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722493d7-40ea-4300-83f0-3e209cb5c1ac', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e9e6bd-2750-4f8e-bd11-4455232132d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:17:54 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Volume volume-722493d7-40ea-4300-83f0-3e209cb5c1ac (722493d7-40ea-4300-83f0-3e209cb5c1ac): created successfully
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e9e6bd-2750-4f8e-bd11-4455232132d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:17:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Flow 'volume_create_manager' (6f7e4f50-a179-4b13-878e-73d1f2d13401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:17:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-602d5422-238e-4f3d-9a5a-e4052bc61968 tempest-GroupSnapshotsV319Test-1683947689 None] Created volume successfully.
Apr 13 11:17:56 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] GroupSnapshot c56b8164-fe42-42e6-b6b7-ed655537cfab: creating.
Apr 13 11:17:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Group snapshot c56b8164-fe42-42e6-b6b7-ed655537cfab: creating. {{(pid=82099) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 11:17:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Creating offline snapshot 4a5f72b7-a031-4421-8fd9-ebab858b2bf6 of volume 722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:17:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d2d72-705d-4ec1-8e75-4021e20d4dbd]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:56 devstack sudo[83421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac
Apr 13 11:17:56 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Acquiring lock "cinder-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "cinder-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Acquiring lock "cinder-quobyte-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "cinder-quobyte-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a" acquired by "delete_volume" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e57402c-bb79-4650-8ab1-6b8cebaa7420]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:57 devstack sudo[83424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a
Apr 13 11:17:57 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:57 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac" returned: 0 in 1.103s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:57 devstack sudo[83429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 1G
Apr 13 11:17:57 devstack sudo[83429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:58 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a" returned: 0 in 1.399s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:58 devstack sudo[83437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a
Apr 13 11:17:58 devstack sudo[83437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:59 devstack sudo[83429]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 1G" returned: 0 in 1.260s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722493d7-40ea-4300-83f0-3e209cb5c1ac -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:59 devstack sudo[83439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722493d7-40ea-4300-83f0-3e209cb5c1ac -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6
Apr 13 11:17:59 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:17:59 devstack sudo[83437]: pam_unix(sudo:session): session closed for user root
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a" returned: 0 in 0.830s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "cinder-quobyte-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a" released by "delete_volume" :: held 2.316s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Created reservations ['196b5640-4e84-457a-b9fd-c494bcab4df5', '6aadb6df-922b-4a37-af40-93362af2404e', '793526ee-a6b8-47b8-8d4c-e8febb8582d0', '758fcc91-7394-472e-a26d-915f94615c74'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:17:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:17:59 devstack sudo[83444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:17:59 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:00 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-722493d7-40ea-4300-83f0-3e209cb5c1ac -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6" returned: 0 in 1.346s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:00 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:18:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:00 devstack sudo[83450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6
Apr 13 11:18:00 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:00 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.911s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:00 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:00 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Deleted volume successfully.
Apr 13 11:18:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5f8e8720-2cc8-4c79-8b31-a8862cdd8171 tempest-ServerRescueNegativeTestJSON-193706527 None] Lock "cinder-eb22e73c-a2a3-4dd7-a79a-f1cf83235a6a-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:01 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6" returned: 0 in 0.986s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:01 devstack sudo[83463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info
Apr 13 11:18:01 devstack sudo[83463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:02 devstack sudo[83463]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info" returned: 0 in 0.736s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:02 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:18:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:02 devstack sudo[83504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info
Apr 13 11:18:02 devstack sudo[83504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:03 devstack sudo[83504]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.info" returned: 0 in 1.075s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.676s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:03 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-14f30f57-d10f-4dfb-af5a-b62c7fd29c6e tempest-GroupSnapshotsV319Test-1683947689 None] group_snapshot c56b8164-fe42-42e6-b6b7-ed655537cfab: created successfully
Apr 13 11:18:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] group_snapshot c56b8164-fe42-42e6-b6b7-ed655537cfab: deleting
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] group_snapshot c56b8164-fe42-42e6-b6b7-ed655537cfab: deleting {{(pid=82099) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "cinder-quobyte-722493d7-40ea-4300-83f0-3e209cb5c1ac" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "cinder-quobyte-722493d7-40ea-4300-83f0-3e209cb5c1ac" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "cinder-quobyte-4a5f72b7-a031-4421-8fd9-ebab858b2bf6" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "cinder-quobyte-4a5f72b7-a031-4421-8fd9-ebab858b2bf6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Deleting offline snapshot 4a5f72b7-a031-4421-8fd9-ebab858b2bf6 of volume 722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] snapshot_file for this snap is: volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d13be59-b026-417f-a661-27e13943f494]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:04 devstack sudo[83523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6
Apr 13 11:18:04 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:05 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6" returned: 0 in 0.732s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-722493d7-40ea-4300-83f0-3e209cb5c1ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:18:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b7e684-3c4e-4773-9607-4d553b29bfeb]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:05 devstack sudo[83528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac
Apr 13 11:18:05 devstack sudo[83528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:06 devstack sudo[83528]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac" returned: 0 in 1.115s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:06 devstack sudo[83540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6
Apr 13 11:18:06 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:07 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6" returned: 0 in 1.008s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:07 devstack sudo[83546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6
Apr 13 11:18:07 devstack sudo[83546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Flow 'volume_create_manager' (e5e6beb5-fcc9-4ae3-9132-05c736c51d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa751f15-7724-437b-89f9-478600ccbdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa751f15-7724-437b-89f9-478600ccbdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:08Z,deleted=False,deleted_at=None,display_description='',display_name='a2c61765-75e2-400d-98a1-6f441825df09-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908c290d-bca6-42dc-9150-e2417a37ce5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4b7ca641ef4408b5afe4b844cdda8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:08Z,use_quota=True,user_id='297889e32e50426fb2e44d8456133949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b21d0b9-fba1-46a4-930f-bac5764cc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b21d0b9-fba1-46a4-930f-bac5764cc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a05226-0c3a-4d78-a7fe-b71aa1bbee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a05226-0c3a-4d78-a7fe-b71aa1bbee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '908c290d-bca6-42dc-9150-e2417a37ce5a', 'volume_name': 'volume-908c290d-bca6-42dc-9150-e2417a37ce5a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4744d64e-0a66-4daf-9864-2ea1b4be0864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4744d64e-0a66-4daf-9864-2ea1b4be0864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81751693-1bda-44fb-930f-112466086892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:08 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Volume 908c290d-bca6-42dc-9150-e2417a37ce5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-908c290d-bca6-42dc-9150-e2417a37ce5a', 'volume_size': 1}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:08Z,deleted=False,deleted_at=None,display_description='',display_name='a2c61765-75e2-400d-98a1-6f441825df09-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908c290d-bca6-42dc-9150-e2417a37ce5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4b7ca641ef4408b5afe4b844cdda8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:08Z,use_quota=True,user_id='297889e32e50426fb2e44d8456133949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Creating volume 908c290d-bca6-42dc-9150-e2417a37ce5a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:08 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:08 devstack sudo[83548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a 1073741824
Apr 13 11:18:08 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:08 devstack sudo[83546]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac.4a5f72b7-a031-4421-8fd9-ebab858b2bf6" returned: 0 in 1.172s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "cinder-quobyte-4a5f72b7-a031-4421-8fd9-ebab858b2bf6" released by "_delete_snapshot" :: held 4.112s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "cinder-quobyte-722493d7-40ea-4300-83f0-3e209cb5c1ac" released by "delete_snapshot" :: held 4.126s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:08 devstack cinder-volume[82099]: WARNING cinder.quota [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1029517527 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1029517527, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:08 devstack cinder-volume[82099]: WARNING cinder.quota [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1029517527 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1029517527, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:08 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] Created reservations ['6d153d44-c6f9-4d0a-bfa6-03e9d24e8a88', 'bf87c09f-c33d-41a5-8413-907e776646c6', 'f5011447-1a7b-4e00-b379-cd54cd07feb3', '5263a4a2-4496-4d98-a1ee-6ca5df931291'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a57c25a7-6f25-4f8b-8b3c-119a5b98e757 tempest-GroupSnapshotsV319Test-1683947689 None] group_snapshot c56b8164-fe42-42e6-b6b7-ed655537cfab: deleted successfully
Apr 13 11:18:09 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a 1073741824" returned: 0 in 1.338s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:09 devstack sudo[83558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a
Apr 13 11:18:09 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "cinder-quobyte-722493d7-40ea-4300-83f0-3e209cb5c1ac" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "cinder-quobyte-722493d7-40ea-4300-83f0-3e209cb5c1ac" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4876db42-2b7a-43f0-91b5-169863b3660e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:10 devstack sudo[83585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac
Apr 13 11:18:10 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:10 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a" returned: 0 in 0.949s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81751693-1bda-44fb-930f-112466086892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908c290d-bca6-42dc-9150-e2417a37ce5a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70657e6-4411-4c3f-878d-19a251da4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:10 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Volume volume-908c290d-bca6-42dc-9150-e2417a37ce5a (908c290d-bca6-42dc-9150-e2417a37ce5a): created successfully
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70657e6-4411-4c3f-878d-19a251da4c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Flow 'volume_create_manager' (e5e6beb5-fcc9-4ae3-9132-05c736c51d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:10 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-217e12e2-44f3-47a4-aa57-227c3a9d90fa tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Created volume successfully.
Apr 13 11:18:10 devstack sudo[83587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:10 devstack sudo[83587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:11 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac" returned: 0 in 1.113s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:11 devstack sudo[83597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac
Apr 13 11:18:11 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:11 devstack sudo[83587]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.250s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:12 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-722493d7-40ea-4300-83f0-3e209cb5c1ac" returned: 0 in 1.022s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "cinder-quobyte-722493d7-40ea-4300-83f0-3e209cb5c1ac" released by "delete_volume" :: held 2.177s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Created reservations ['cd8fd846-9238-473c-8107-b84d980e3682'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:12 devstack cinder-volume[82099]: WARNING cinder.quota [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1029517527 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1029517527, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Created reservations ['508b808b-3954-47c2-9e48-603591b33044', '7efd3699-6eca-49c3-b639-792c07742c32', 'f5b51eb0-65fe-4587-a576-ab1604d80720', '572fef84-ffc6-4d9e-b8eb-f57fb5ad63fb'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:13 devstack sudo[83644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:13 devstack sudo[83644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:13 devstack cinder-volume[82099]: WARNING py.warnings [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 13 11:18:13 devstack cinder-volume[82099]:   .first()
Apr 13 11:18:13 devstack cinder-volume[82099]: 
Apr 13 11:18:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:13 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7ad7a2-bcf3-4e75-9650-e867b5050ee3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:14 devstack sudo[83644]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.061s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:14 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-63734e71-2859-4bea-b1a3-1ea4319c0987 tempest-GroupSnapshotsV319Test-1683947689 None] Delete group completed successfully.
Apr 13 11:18:14 devstack sudo[83670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a
Apr 13 11:18:14 devstack sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:14 devstack sudo[83670]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a" returned: 0 in 0.795s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.827s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d', 'name': 'volume-908c290d-bca6-42dc-9150-e2417a37ce5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b42982c-072d-4176-ae18-559664645c54', 'enforce_multipath': True} {{(pid=82099) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 11:18:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-1c2d2457-9c80-46a9-b3ad-f8a7f76ee143 req-bb9430fe-8ce2-44c2-be08-7d7632375ea0 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] attachment_update completed successfully.
Apr 13 11:18:20 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=71,cinder:UPDATE=82,cinder:INSERT=29,cinder:DELETE=5 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:18:20 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=66,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=8 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Flow 'volume_create_manager' (9b1606c0-e72c-4e4f-99b7-fbb071b1b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053fc2e4-1b6a-47d8-9a39-61edba8169b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053fc2e4-1b6a-47d8-9a39-61edba8169b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1020989033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a54ae0e5a66b46eeb991bbfcfb3554e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:25Z,use_quota=True,user_id='441be3b64f26418a9978e8c483411df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef72a03a-5ec8-418e-8962-cf90f3399a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef72a03a-5ec8-418e-8962-cf90f3399a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356d5527-59d9-446a-ad72-c8bb664a1a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356d5527-59d9-446a-ad72-c8bb664a1a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001', 'volume_name': 'volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f1be15-7af0-4c00-a62f-3b670ece2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f1be15-7af0-4c00-a62f-3b670ece2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f5c5dd-a0e0-4754-b50e-5a14cd5e984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:25 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Volume 7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001', 'volume_size': 1}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1020989033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a54ae0e5a66b46eeb991bbfcfb3554e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:25Z,use_quota=True,user_id='441be3b64f26418a9978e8c483411df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Creating volume 7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:25 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:25 devstack sudo[84112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 1073741824
Apr 13 11:18:25 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:26 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 1073741824" returned: 0 in 0.626s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:26 devstack sudo[84130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001
Apr 13 11:18:26 devstack sudo[84130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:26 devstack sudo[84130]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001" returned: 0 in 0.493s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f5c5dd-a0e0-4754-b50e-5a14cd5e984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d1456b-638a-4aef-9ef7-2bc31162d472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:26 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Volume volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 (7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001): created successfully
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d1456b-638a-4aef-9ef7-2bc31162d472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Flow 'volume_create_manager' (9b1606c0-e72c-4e4f-99b7-fbb071b1b757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:26 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-45ed40c4-30f3-4c02-bf3e-c2cac1247a53 req-8d29af93-205b-44de-ad3f-392bab591d2d tempest-VolumesGetTestJSON-1011168697 None] Created volume successfully.
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Acquiring lock "cinder-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Lock "cinder-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Acquiring lock "cinder-quobyte-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Lock "cinder-quobyte-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001" acquired by "delete_volume" :: waited 0.018s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6ad445-6bde-4df9-bfe9-55b9bbee1ef3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:28 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-92b1a5dc-ed14-434d-8e5f-808bf9a90432 tempest-GroupsTest-926145462 None] Group tempest-Group1-418511825: creating
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:28 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-92b1a5dc-ed14-434d-8e5f-808bf9a90432 tempest-GroupsTest-926145462 None] Group tempest-Group1-418511825: created successfully
Apr 13 11:18:28 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-92b1a5dc-ed14-434d-8e5f-808bf9a90432 tempest-GroupsTest-926145462 None] Create group completed successfully.
Apr 13 11:18:28 devstack sudo[84134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001
Apr 13 11:18:28 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:28 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001" returned: 0 in 0.665s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:28 devstack sudo[84162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001
Apr 13 11:18:29 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:29 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001" returned: 0 in 0.525s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Lock "cinder-quobyte-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001" released by "delete_volume" :: held 1.264s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9b8805bf-2e8c-433c-bce6-bcede5d98511 tempest-GroupsTest-926145462 None] Group tempest-Group2-233532127: creating
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG cinder.quota [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Created reservations ['2331e25c-9a0c-4c70-90d5-0862b06a000a', 'd93d9454-a3b9-4f63-a719-0e2c89734585', '5876315b-5a2d-4c3d-a1ab-a2ed027499a3', 'e07e27bd-6dc5-4c8e-b62f-191b4c04710c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9b8805bf-2e8c-433c-bce6-bcede5d98511 tempest-GroupsTest-926145462 None] Group tempest-Group2-233532127: created successfully
Apr 13 11:18:29 devstack sudo[84173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:29 devstack sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9b8805bf-2e8c-433c-bce6-bcede5d98511 tempest-GroupsTest-926145462 None] Create group completed successfully.
Apr 13 11:18:30 devstack sudo[84173]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.429s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:30 devstack cinder-volume[82099]: DEBUG cinder.manager [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Deleted volume successfully.
Apr 13 11:18:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-f08e06cb-7dde-431d-9a4e-2ccd95866293 req-60614b43-98e3-424d-8c2e-bb64ef674db4 tempest-VolumesGetTestJSON-1011168697 None] Lock "cinder-7cb6f48f-1a0f-4a0a-ab7c-2ebfe1e59001-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Flow 'volume_create_manager' (400b04b3-ffac-4a99-95ae-c07526f08c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7262e1-46d5-411e-bfe8-fe0550a051d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7262e1-46d5-411e-bfe8-fe0550a051d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-192486754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=088f151d-d5f0-47b5-bc30-dee60db15b61,host='devstack@QuobyteHD#QuobyteHD',id=e4d14e55-44f8-4c3b-9be3-3de92d8a7c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adc8eff6aa49eebf34c3b637110f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:31Z,use_quota=True,user_id='a8b17ca1f48543bf951834b8e463ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eacd39ff-1752-40f4-9e31-c2f928c1e5a4),volume_type_id=eacd39ff-1752-40f4-9e31-c2f928c1e5a4)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d353f-0a6f-48b0-a79c-2cfddca51346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d353f-0a6f-48b0-a79c-2cfddca51346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88083b33-9008-4cb1-bde0-673a8f654353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88083b33-9008-4cb1-bde0-673a8f654353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d14e55-44f8-4c3b-9be3-3de92d8a7c81', 'volume_name': 'volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c620859e-0b2f-4c0d-8353-3b18117308c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c620859e-0b2f-4c0d-8353-3b18117308c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8d0412-b02a-479b-a66c-f697cadca6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:31 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Volume e4d14e55-44f8-4c3b-9be3-3de92d8a7c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81', 'volume_size': 1}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=088f151d-d5f0-47b5-bc30-dee60db15b61,created_at=2026-04-13T09:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-192486754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=088f151d-d5f0-47b5-bc30-dee60db15b61,host='devstack@QuobyteHD#QuobyteHD',id=e4d14e55-44f8-4c3b-9be3-3de92d8a7c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adc8eff6aa49eebf34c3b637110f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:31Z,use_quota=True,user_id='a8b17ca1f48543bf951834b8e463ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eacd39ff-1752-40f4-9e31-c2f928c1e5a4),volume_type_id=eacd39ff-1752-40f4-9e31-c2f928c1e5a4)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Creating volume e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:31 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:31 devstack sudo[84222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 1073741824
Apr 13 11:18:31 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:32 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 1073741824" returned: 0 in 0.952s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:32 devstack sudo[84235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81
Apr 13 11:18:32 devstack sudo[84235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:32 devstack sudo[84235]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81" returned: 0 in 0.519s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8d0412-b02a-479b-a66c-f697cadca6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c57a91-f6d8-4e1c-8152-e38dd6bb3b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:32 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Volume volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 (e4d14e55-44f8-4c3b-9be3-3de92d8a7c81): created successfully
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c57a91-f6d8-4e1c-8152-e38dd6bb3b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Flow 'volume_create_manager' (400b04b3-ffac-4a99-95ae-c07526f08c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:32 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9966fcbb-9a0e-40e2-ab02-3ac0f9121f89 tempest-GroupsTest-926145462 None] Created volume successfully.
Apr 13 11:18:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Acquiring lock "cinder-quobyte-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Lock "cinder-quobyte-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81" acquired by "delete_volume" :: waited 0.018s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:33 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b144ee5-a739-491e-9798-7beaca4d30a1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:33 devstack sudo[84240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81
Apr 13 11:18:33 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Flow 'volume_create_manager' (f2333636-c9a3-4267-abf5-e9f97389dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a181af5d-aa89-4345-996b-2176766f04d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a181af5d-aa89-4345-996b-2176766f04d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-758296251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83b60a0-cd5d-4efa-be66-bccfce4f1337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f94317129b549028a9f11c3a2715d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:34Z,use_quota=True,user_id='509b1a0b1a9e429187a962a5153fbf98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6c74d1-cbc4-4492-a474-4525614f60e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6c74d1-cbc4-4492-a474-4525614f60e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1418e75a-2634-4588-8932-a7ac3309090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1418e75a-2634-4588-8932-a7ac3309090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83b60a0-cd5d-4efa-be66-bccfce4f1337', 'volume_name': 'volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422e66ac-6f09-4bf7-8fc1-8cf5120b36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422e66ac-6f09-4bf7-8fc1-8cf5120b36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d62756-6422-4a55-9428-e8e7399acac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Volume b83b60a0-cd5d-4efa-be66-bccfce4f1337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337', 'volume_size': 1}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-758296251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83b60a0-cd5d-4efa-be66-bccfce4f1337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f94317129b549028a9f11c3a2715d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:34Z,use_quota=True,user_id='509b1a0b1a9e429187a962a5153fbf98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Creating volume b83b60a0-cd5d-4efa-be66-bccfce4f1337 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:34 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:34 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 1073741824
Apr 13 11:18:34 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:34 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81" returned: 0 in 0.802s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:34 devstack sudo[84247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81
Apr 13 11:18:34 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:35 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81" returned: 0 in 0.700s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Lock "cinder-quobyte-e4d14e55-44f8-4c3b-9be3-3de92d8a7c81" released by "delete_volume" :: held 1.562s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Created reservations ['a8cc21d6-0f70-43e9-998a-8ac520c23a38'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:35 devstack cinder-volume[82099]: WARNING cinder.quota [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1426664478 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1426664478, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:35 devstack cinder-volume[82099]: WARNING cinder.quota [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1426664478 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1426664478, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Created reservations ['a7153712-5cec-490a-9767-a3f585ed9e20', '7507df32-23ec-4b08-a810-82623d4412a1', '5e983aa1-8bb4-444d-ba6e-d05de7bc1ec8', '5789cc98-bd17-43e9-8ba3-6659f6fd8176'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:35 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 1073741824" returned: 0 in 1.171s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:35 devstack sudo[84282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337
Apr 13 11:18:35 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:35 devstack sudo[84284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:35 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Created reservations ['2c6843f9-9f71-4486-86a8-ee02b940460e'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:36 devstack sudo[84288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:36 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:36 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337" returned: 0 in 1.161s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d62756-6422-4a55-9428-e8e7399acac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bef165-b91c-4db6-8f7b-8459d87a7a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Volume volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 (b83b60a0-cd5d-4efa-be66-bccfce4f1337): created successfully
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bef165-b91c-4db6-8f7b-8459d87a7a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Flow 'volume_create_manager' (f2333636-c9a3-4267-abf5-e9f97389dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d5294460-9afa-489e-8a98-3978127377ff tempest-DeleteServersTestJSON-1278576933 None] Created volume successfully.
Apr 13 11:18:37 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.217s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:37 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ef8f0f17-abb6-40b3-916a-cafe4bbb82d7 tempest-GroupsTest-926145462 None] Delete group completed successfully.
Apr 13 11:18:37 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.568s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:37 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4c3cb202-7694-4138-8c92-d71df19845ba tempest-GroupsTest-926145462 None] Delete group completed successfully.
Apr 13 11:18:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-20a9d8c5-92a5-46fb-ae26-fbeb9b324d95 tempest-GroupsTest-926145462 None] Group tempest-GroupsTest-Group-1548708141: creating
Apr 13 11:18:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-20a9d8c5-92a5-46fb-ae26-fbeb9b324d95 tempest-GroupsTest-926145462 None] Group tempest-GroupsTest-Group-1548708141: created successfully
Apr 13 11:18:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-20a9d8c5-92a5-46fb-ae26-fbeb9b324d95 tempest-GroupsTest-926145462 None] Create group completed successfully.
Apr 13 11:18:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e2207bb7-972c-4fd1-86bc-422e7f6b44fe tempest-GroupSnapshotsTest-1365298579 None] Group tempest-GroupSnapshotsTest-Group-237899183: creating
Apr 13 11:18:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e2207bb7-972c-4fd1-86bc-422e7f6b44fe tempest-GroupSnapshotsTest-1365298579 None] Group tempest-GroupSnapshotsTest-Group-237899183: created successfully
Apr 13 11:18:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e2207bb7-972c-4fd1-86bc-422e7f6b44fe tempest-GroupSnapshotsTest-1365298579 None] Create group completed successfully.
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Flow 'volume_create_manager' (6139187e-4b98-4a3c-9b25-9363f5c05f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c1e857-c5f6-48e2-a106-854ba29b32d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c1e857-c5f6-48e2-a106-854ba29b32d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203609734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f26eebdb-137f-446a-9ff6-2d08abc0c2ae,host='devstack@QuobyteHD#QuobyteHD',id=3cc07e9b-27a4-4edd-b554-54626c241de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adc8eff6aa49eebf34c3b637110f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:40Z,use_quota=True,user_id='a8b17ca1f48543bf951834b8e463ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc4657f-faeb-4e7b-b964-886c1e70cd8f),volume_type_id=cfc4657f-faeb-4e7b-b964-886c1e70cd8f)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fabf894-0187-4859-8fb0-06e2c7eeb069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fabf894-0187-4859-8fb0-06e2c7eeb069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d7cc6f-158e-4d9f-9eb4-6c7e61601dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d7cc6f-158e-4d9f-9eb4-6c7e61601dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc07e9b-27a4-4edd-b554-54626c241de6', 'volume_name': 'volume-3cc07e9b-27a4-4edd-b554-54626c241de6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cbcf8b-1dab-421e-ba41-43d51ab10825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cbcf8b-1dab-421e-ba41-43d51ab10825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd56b8-8e16-433e-a15e-d7b4ba7309e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Volume 3cc07e9b-27a4-4edd-b554-54626c241de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc07e9b-27a4-4edd-b554-54626c241de6', 'volume_size': 1}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f26eebdb-137f-446a-9ff6-2d08abc0c2ae,created_at=2026-04-13T09:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203609734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f26eebdb-137f-446a-9ff6-2d08abc0c2ae,host='devstack@QuobyteHD#QuobyteHD',id=3cc07e9b-27a4-4edd-b554-54626c241de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adc8eff6aa49eebf34c3b637110f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:40Z,use_quota=True,user_id='a8b17ca1f48543bf951834b8e463ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc4657f-faeb-4e7b-b964-886c1e70cd8f),volume_type_id=cfc4657f-faeb-4e7b-b964-886c1e70cd8f)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Creating volume 3cc07e9b-27a4-4edd-b554-54626c241de6 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:40 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:40 devstack sudo[84326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6 1073741824
Apr 13 11:18:40 devstack sudo[84326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (6e060b1b-6972-4eb1-a829-3b6fc8dfdd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091185ce-88e9-4342-ac16-43628cc075e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091185ce-88e9-4342-ac16-43628cc075e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-627430897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a913c1c8-6f85-4395-8a26-18357265ae71,host='devstack@QuobyteHD#QuobyteHD',id=8c932f47-b62d-457f-b069-835aa1cab41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:41Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34d270c-60e7-4bd3-b154-e76c3082671a),volume_type_id=c34d270c-60e7-4bd3-b154-e76c3082671a)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b66561-1ff4-43e1-a655-2ce27a974c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b66561-1ff4-43e1-a655-2ce27a974c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166bb485-c4b7-44ec-a11a-2aa9103cec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166bb485-c4b7-44ec-a11a-2aa9103cec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c932f47-b62d-457f-b069-835aa1cab41f', 'volume_name': 'volume-8c932f47-b62d-457f-b069-835aa1cab41f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4bb813-c54d-49ae-9598-d6793bcb533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4bb813-c54d-49ae-9598-d6793bcb533d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b21f4bf-b615-41e3-95c3-01992146b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Volume 8c932f47-b62d-457f-b069-835aa1cab41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c932f47-b62d-457f-b069-835aa1cab41f', 'volume_size': 1}
Apr 13 11:18:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:41 devstack sudo[84326]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6 1073741824" returned: 0 in 0.913s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:41 devstack sudo[84355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6
Apr 13 11:18:41 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:41 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6" returned: 0 in 0.633s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.097s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a913c1c8-6f85-4395-8a26-18357265ae71,created_at=2026-04-13T09:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-627430897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a913c1c8-6f85-4395-8a26-18357265ae71,host='devstack@QuobyteHD#QuobyteHD',id=8c932f47-b62d-457f-b069-835aa1cab41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:41Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34d270c-60e7-4bd3-b154-e76c3082671a),volume_type_id=c34d270c-60e7-4bd3-b154-e76c3082671a)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Creating volume 8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:41 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd56b8-8e16-433e-a15e-d7b4ba7309e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc07e9b-27a4-4edd-b554-54626c241de6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cbf1f1-056f-449d-801b-d68998b959e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:41 devstack sudo[84389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f 1073741824
Apr 13 11:18:41 devstack sudo[84389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:41 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Volume volume-3cc07e9b-27a4-4edd-b554-54626c241de6 (3cc07e9b-27a4-4edd-b554-54626c241de6): created successfully
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cbf1f1-056f-449d-801b-d68998b959e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Flow 'volume_create_manager' (6139187e-4b98-4a3c-9b25-9363f5c05f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:41 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0cfa88f9-5924-49ec-8c10-eae67d16674c tempest-GroupsTest-926145462 None] Created volume successfully.
Apr 13 11:18:42 devstack sudo[84389]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f 1073741824" returned: 0 in 0.779s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:42 devstack sudo[84396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:18:42 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Flow 'volume_create_manager' (81ec1036-8311-4179-b2e2-46ca4ea8042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7b8b7-2a00-4816-aa1d-3e6a0f665663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7b8b7-2a00-4816-aa1d-3e6a0f665663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1069879584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f26eebdb-137f-446a-9ff6-2d08abc0c2ae,host='devstack@QuobyteHD#QuobyteHD',id=9c9646fd-d253-4b52-943a-39cf722fa67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adc8eff6aa49eebf34c3b637110f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:43Z,use_quota=True,user_id='a8b17ca1f48543bf951834b8e463ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc4657f-faeb-4e7b-b964-886c1e70cd8f),volume_type_id=cfc4657f-faeb-4e7b-b964-886c1e70cd8f)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e19905-d174-43e2-905c-60ff93853253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e19905-d174-43e2-905c-60ff93853253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1bc540-d9c5-41d3-bae8-ecf7766592a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1bc540-d9c5-41d3-bae8-ecf7766592a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9646fd-d253-4b52-943a-39cf722fa67e', 'volume_name': 'volume-9c9646fd-d253-4b52-943a-39cf722fa67e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87945e36-a01a-46c9-a614-44b910449c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87945e36-a01a-46c9-a614-44b910449c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3db6d8b-6aa9-4488-83d0-46fa8fadaefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:42 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Volume 9c9646fd-d253-4b52-943a-39cf722fa67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9646fd-d253-4b52-943a-39cf722fa67e', 'volume_size': 1}
Apr 13 11:18:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:43 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.662s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b21f4bf-b615-41e3-95c3-01992146b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c932f47-b62d-457f-b069-835aa1cab41f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a833b8-59d1-4ee0-b4a2-61e5f4bef747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5562cd8-a32e-487d-882b-57fe840c533b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:43 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Volume volume-8c932f47-b62d-457f-b069-835aa1cab41f (8c932f47-b62d-457f-b069-835aa1cab41f): created successfully
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a833b8-59d1-4ee0-b4a2-61e5f4bef747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (6e060b1b-6972-4eb1-a829-3b6fc8dfdd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:43 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-24151fb2-cd02-4bae-8431-6b6753c54bb1 tempest-GroupSnapshotsTest-1365298579 None] Created volume successfully.
Apr 13 11:18:43 devstack sudo[84399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337
Apr 13 11:18:43 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:43 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337" returned: 0 in 0.543s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.561s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f26eebdb-137f-446a-9ff6-2d08abc0c2ae,created_at=2026-04-13T09:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1069879584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f26eebdb-137f-446a-9ff6-2d08abc0c2ae,host='devstack@QuobyteHD#QuobyteHD',id=9c9646fd-d253-4b52-943a-39cf722fa67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34adc8eff6aa49eebf34c3b637110f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:43Z,use_quota=True,user_id='a8b17ca1f48543bf951834b8e463ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfc4657f-faeb-4e7b-b964-886c1e70cd8f),volume_type_id=cfc4657f-faeb-4e7b-b964-886c1e70cd8f)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Creating volume 9c9646fd-d253-4b52-943a-39cf722fa67e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:43 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:43 devstack sudo[84405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e 1073741824
Apr 13 11:18:43 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d', 'name': 'volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b549999-c17b-4f45-a055-759663c565f7', 'enforce_multipath': True} {{(pid=82099) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 11:18:43 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-e171c967-4f18-4ff8-b68b-c3d7dbd7fc16 req-f770cc56-4b34-4dec-8b70-fd468283171f tempest-DeleteServersTestJSON-1278576933 None] attachment_update completed successfully.
Apr 13 11:18:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] GroupSnapshot 88380cfc-0181-4814-9b9e-f44fc554316d: creating.
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Group snapshot 88380cfc-0181-4814-9b9e-f44fc554316d: creating. {{(pid=82099) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:44 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e 1073741824" returned: 0 in 0.764s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:44 devstack sudo[84410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e
Apr 13 11:18:44 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:44 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e" returned: 0 in 0.507s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.817s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3db6d8b-6aa9-4488-83d0-46fa8fadaefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9646fd-d253-4b52-943a-39cf722fa67e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd63961-86d8-4b27-bc93-c55811f72cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Creating offline snapshot d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 of volume 8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:18:44 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Volume volume-9c9646fd-d253-4b52-943a-39cf722fa67e (9c9646fd-d253-4b52-943a-39cf722fa67e): created successfully
Apr 13 11:18:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd63961-86d8-4b27-bc93-c55811f72cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Flow 'volume_create_manager' (81ec1036-8311-4179-b2e2-46ca4ea8042a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:45 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1afacf-fd3e-4202-96a5-568db463b476]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:45 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2eca745c-eb96-4616-becd-8d94ac39d0d6 tempest-GroupsTest-926145462 None] Created volume successfully.
Apr 13 11:18:45 devstack sudo[84421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:18:45 devstack sudo[84421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:45 devstack sudo[84421]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.516s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:45 devstack sudo[84428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 1G
Apr 13 11:18:45 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:46 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 1G" returned: 0 in 0.600s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c932f47-b62d-457f-b069-835aa1cab41f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:46 devstack sudo[84433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c932f47-b62d-457f-b069-835aa1cab41f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355
Apr 13 11:18:46 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:46 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c439a13e-1f7d-4169-a551-d4e50a763aa4 tempest-GroupsTest-926145462 None] Update group completed successfully.
Apr 13 11:18:46 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c932f47-b62d-457f-b069-835aa1cab41f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" returned: 0 in 0.447s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:46 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:18:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:46 devstack sudo[84438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355
Apr 13 11:18:46 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:46 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" returned: 0 in 0.416s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:47 devstack sudo[84441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info
Apr 13 11:18:47 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:47 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2e7a7ba8-b607-44e4-b868-e57e31500bea tempest-GroupsTest-926145462 None] Update group completed successfully.
Apr 13 11:18:47 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:47 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:18:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:47 devstack sudo[84445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info
Apr 13 11:18:47 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:48 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.info" returned: 0 in 0.535s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-92c8d3ec-4ae7-4eea-b44d-dacce6f6446b tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 88380cfc-0181-4814-9b9e-f44fc554316d: created successfully
Apr 13 11:18:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Acquiring lock "cinder-quobyte-3cc07e9b-27a4-4edd-b554-54626c241de6" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Lock "cinder-quobyte-3cc07e9b-27a4-4edd-b554-54626c241de6" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e5ff7b-b41e-4e88-8023-210c04fa08d4]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:48 devstack sudo[84455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6
Apr 13 11:18:48 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-d9f02994-6a8b-4fe1-b4f6-5e258c7b6355-b8458b51-967a-42cd-9066-8ee3bfa32482" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-d9f02994-6a8b-4fe1-b4f6-5e258c7b6355-b8458b51-967a-42cd-9066-8ee3bfa32482" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Creating volume b8458b51-967a-42cd-9066-8ee3bfa32482 from snapshot d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-b8458b51-967a-42cd-9066-8ee3bfa32482" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-b8458b51-967a-42cd-9066-8ee3bfa32482" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] snapshot: d9f02994-6a8b-4fe1-b4f6-5e258c7b6355, volume: b8458b51-967a-42cd-9066-8ee3bfa32482,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9920a-1fb3-4182-84cf-f778afc87d86]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:49 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6" returned: 0 in 0.755s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:49 devstack sudo[84478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6
Apr 13 11:18:49 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:49 devstack sudo[84477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355
Apr 13 11:18:49 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:50 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" returned: 0 in 0.623s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c932f47-b62d-457f-b069-835aa1cab41f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b8940c-3bd1-4c26-b9e1-e42bc50c5141]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:50 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3cc07e9b-27a4-4edd-b554-54626c241de6" returned: 0 in 0.615s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Lock "cinder-quobyte-3cc07e9b-27a4-4edd-b554-54626c241de6" released by "delete_volume" :: held 1.395s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Acquiring lock "cinder-quobyte-9c9646fd-d253-4b52-943a-39cf722fa67e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Lock "cinder-quobyte-9c9646fd-d253-4b52-943a-39cf722fa67e" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1d5de0-e10b-487a-9cac-8128828433bb]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:50 devstack sudo[84488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:18:50 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:50 devstack sudo[84489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e
Apr 13 11:18:50 devstack sudo[84489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:50 devstack sudo[84489]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e" returned: 0 in 0.739s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:50 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.842s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:50 devstack sudo[84502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:18:50 devstack sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:50 devstack sudo[84504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482
Apr 13 11:18:50 devstack sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-1ec68ae7-6a06-4c81-a1cc-a1bf18c2c1e9 req-fba43f2e-2f3b-4a52-aac9-3b2ae39fb767 tempest-DeleteServersTestJSON-1278576933 None] Terminate volume connection completed successfully.
Apr 13 11:18:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-1ec68ae7-6a06-4c81-a1cc-a1bf18c2c1e9 req-fba43f2e-2f3b-4a52-aac9-3b2ae39fb767 tempest-DeleteServersTestJSON-1278576933 None] Deleting attachment 4b549999-c17b-4f45-a055-759663c565f7. {{(pid=82099) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 11:18:51 devstack sudo[84502]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c9646fd-d253-4b52-943a-39cf722fa67e" returned: 0 in 0.563s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Lock "cinder-quobyte-9c9646fd-d253-4b52-943a-39cf722fa67e" released by "delete_volume" :: held 1.326s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:51 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Created reservations ['c1ac1088-5c04-4090-b79a-ceb1739918f5'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:51 devstack cinder-volume[82099]: WARNING cinder.quota [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-871231525 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-871231525, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:51 devstack cinder-volume[82099]: WARNING cinder.quota [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-871231525 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-871231525, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:51 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Created reservations ['7c71041f-a284-4976-bbd3-161c44ea36c6', '4099d531-c129-4861-a3d6-df822fb32aed', 'e2562ff0-9456-4278-8b77-2466355500a4', 'c7cfcdee-07e7-47f7-9664-0b8a24838d22'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:51 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Created reservations ['1c2d2187-3a61-49c6-9c01-ea4c095f2d52', '9845b5af-2e91-4eaf-bffb-4e01d80a9fd5', '77403cd9-747e-4181-8b52-5f4f11922edd', '4c21baad-7b9c-437c-ad47-689e566b138f'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:52 devstack sudo[84550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:52 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:53 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.962s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:53 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:53 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ec5c3fac-1968-4bac-af40-39025e83f9ed tempest-GroupsTest-926145462 None] Delete group completed successfully.
Apr 13 11:18:54 devstack sudo[84504]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482" returned: 0 in 3.112s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:54 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2337f12a-7d82-468e-b550-2e677d9c1dd7]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:54 devstack sudo[84554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:18:54 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:54 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.706s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:54 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f, size 1024.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:18:54 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Converted 1024.00 MB image at 328.97 MB/s
Apr 13 11:18:54 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:18:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:54 devstack sudo[84559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482
Apr 13 11:18:54 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:55 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482" returned: 0 in 0.496s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-b8458b51-967a-42cd-9066-8ee3bfa32482" released by "_copy_volume_from_snapshot" :: held 5.863s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-d9f02994-6a8b-4fe1-b4f6-5e258c7b6355-b8458b51-967a-42cd-9066-8ee3bfa32482" released by "_create_volume_from_snapshot" :: held 5.884s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.903s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:55 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-85eb9142-3aa1-4757-a2c5-928d8434c324 tempest-GroupSnapshotsTest-1365298579 None] Create group from source-snapshot-88380cfc-0181-4814-9b9e-f44fc554316d completed successfully.
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-b8458b51-967a-42cd-9066-8ee3bfa32482" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-b8458b51-967a-42cd-9066-8ee3bfa32482" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edbccc0-0521-4ef2-9b76-58613b5ba129]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:56 devstack sudo[84565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482
Apr 13 11:18:56 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Acquiring lock "cinder-b83b60a0-cd5d-4efa-be66-bccfce4f1337-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Lock "cinder-b83b60a0-cd5d-4efa-be66-bccfce4f1337-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Acquiring lock "cinder-quobyte-b83b60a0-cd5d-4efa-be66-bccfce4f1337" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Lock "cinder-quobyte-b83b60a0-cd5d-4efa-be66-bccfce4f1337" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae685b4c-fb48-43b9-895f-b4b32ee014d6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:56 devstack sudo[84567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337
Apr 13 11:18:56 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:57 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482" returned: 0 in 1.103s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:57 devstack sudo[84600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482
Apr 13 11:18:57 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:57 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337" returned: 0 in 0.897s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:57 devstack sudo[84606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337
Apr 13 11:18:57 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:57 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0e728a27-9d1e-4ca8-b5e6-d1863122f381 tempest-GroupsV314Test-63529380 None] Group tempest-GroupsV314Test-Group-76654672: creating
Apr 13 11:18:57 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0e728a27-9d1e-4ca8-b5e6-d1863122f381 tempest-GroupsV314Test-63529380 None] Group tempest-GroupsV314Test-Group-76654672: created successfully
Apr 13 11:18:57 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0e728a27-9d1e-4ca8-b5e6-d1863122f381 tempest-GroupsV314Test-63529380 None] Create group completed successfully.
Apr 13 11:18:57 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8458b51-967a-42cd-9066-8ee3bfa32482" returned: 0 in 0.727s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:57 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b83b60a0-cd5d-4efa-be66-bccfce4f1337" returned: 0 in 0.560s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-b8458b51-967a-42cd-9066-8ee3bfa32482" released by "delete_volume" :: held 1.864s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Lock "cinder-quobyte-b83b60a0-cd5d-4efa-be66-bccfce4f1337" released by "delete_volume" :: held 1.505s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Created reservations ['6f993aff-7bdf-4c75-af11-416d60660400', '10c78b8c-441a-40f5-bb0a-13c72ebd4c83', 'b61f14ee-6491-4f63-b9fe-d2df18ac1100', 'ac602103-17e0-480f-a00c-2da7727bc781'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['f2ea7295-680d-4cc1-9c3b-3ba000ab7118'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:57 devstack cinder-volume[82099]: WARNING cinder.quota [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-230528956 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-230528956, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:57 devstack cinder-volume[82099]: WARNING cinder.quota [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-230528956 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-230528956, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['38bcdefe-13ec-4afc-8849-c643483ed893', 'f3241ee0-a744-4a59-82c0-55ff6d014f03', '5f35b5d7-423e-4218-951c-85f600d2fb15', '970a3a18-c472-4924-bde8-67a8d5467945'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:18:57 devstack sudo[84611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:57 devstack sudo[84611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:58 devstack sudo[84613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:18:58 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 88380cfc-0181-4814-9b9e-f44fc554316d: deleting
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 88380cfc-0181-4814-9b9e-f44fc554316d: deleting {{(pid=82099) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-8c932f47-b62d-457f-b069-835aa1cab41f" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-8c932f47-b62d-457f-b069-835aa1cab41f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Deleting offline snapshot d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 of volume 8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] snapshot_file for this snap is: volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18f87b-3a00-4ad9-a896-3e8132e7629a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:58 devstack sudo[84611]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.587s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Deleted volume successfully.
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a5e5d22-3695-484b-850d-696bcd0493a6 tempest-DeleteServersTestJSON-1278576933 None] Lock "cinder-b83b60a0-cd5d-4efa-be66-bccfce4f1337-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:18:58 devstack sudo[84616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355
Apr 13 11:18:58 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:58 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.757s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:58 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:18:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e5d79e38-66b5-4f7c-a434-bc516c7e107c tempest-GroupSnapshotsTest-1365298579 None] Delete group completed successfully.
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Flow 'volume_create_manager' (8208c16b-ebed-4ce4-9733-6893659571dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3c6016-01a1-405f-96fc-e558a78c3cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3c6016-01a1-405f-96fc-e558a78c3cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-807571182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5464b258-c5bb-410e-b268-a7f830d4418d,host='devstack@QuobyteHD#QuobyteHD',id=6c065315-766f-492b-b3da-43ecd1e13e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07096d8dbe774a019110de87d50fb9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:59Z,use_quota=True,user_id='b57e39fcd4464e4b93b614c6ed20f68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f77395b0-c061-486a-b3ef-b0b9b9c6b66d),volume_type_id=f77395b0-c061-486a-b3ef-b0b9b9c6b66d)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595a7931-923e-44e0-9df6-9ea5da6280d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595a7931-923e-44e0-9df6-9ea5da6280d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a05fdb-8281-42e3-bdf7-fe343d787e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a05fdb-8281-42e3-bdf7-fe343d787e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c065315-766f-492b-b3da-43ecd1e13e1e', 'volume_name': 'volume-6c065315-766f-492b-b3da-43ecd1e13e1e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebd55c1-f56a-49ee-9967-c2ddff39e078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebd55c1-f56a-49ee-9967-c2ddff39e078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95103a6d-f91d-4355-80be-b86c99b8b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:18:59 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Volume 6c065315-766f-492b-b3da-43ecd1e13e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c065315-766f-492b-b3da-43ecd1e13e1e', 'volume_size': 1}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5464b258-c5bb-410e-b268-a7f830d4418d,created_at=2026-04-13T09:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-807571182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5464b258-c5bb-410e-b268-a7f830d4418d,host='devstack@QuobyteHD#QuobyteHD',id=6c065315-766f-492b-b3da-43ecd1e13e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07096d8dbe774a019110de87d50fb9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:18:59Z,use_quota=True,user_id='b57e39fcd4464e4b93b614c6ed20f68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f77395b0-c061-486a-b3ef-b0b9b9c6b66d),volume_type_id=f77395b0-c061-486a-b3ef-b0b9b9c6b66d)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Creating volume 6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:18:59 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:59 devstack sudo[84620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e 1073741824
Apr 13 11:18:59 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:59 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" returned: 0 in 1.196s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c932f47-b62d-457f-b069-835aa1cab41f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[140901ef-9541-4592-beb0-6a86027862a3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:59 devstack sudo[84625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:18:59 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:18:59 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e 1073741824" returned: 0 in 0.650s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:18:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:18:59 devstack sudo[84631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:18:59 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:00 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.688s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:00 devstack sudo[84637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355
Apr 13 11:19:00 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:00 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.460s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95103a6d-f91d-4355-80be-b86c99b8b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c065315-766f-492b-b3da-43ecd1e13e1e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fe6cf1-31be-4fd4-9e13-238d09fc1215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:00 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Volume volume-6c065315-766f-492b-b3da-43ecd1e13e1e (6c065315-766f-492b-b3da-43ecd1e13e1e): created successfully
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fe6cf1-31be-4fd4-9e13-238d09fc1215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Flow 'volume_create_manager' (8208c16b-ebed-4ce4-9733-6893659571dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:00 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-80a86730-2b13-44eb-9eb8-f2769b8fe5ad tempest-GroupsV314Test-63529380 None] Created volume successfully.
Apr 13 11:19:00 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" returned: 0 in 0.613s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:00 devstack sudo[84644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355
Apr 13 11:19:00 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:01 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f.d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" returned: 0 in 0.586s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-d9f02994-6a8b-4fe1-b4f6-5e258c7b6355" released by "_delete_snapshot" :: held 3.210s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-8c932f47-b62d-457f-b069-835aa1cab41f" released by "delete_snapshot" :: held 3.236s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:01 devstack cinder-volume[82099]: WARNING cinder.quota [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-230528956 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-230528956, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:01 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['22758a86-bfe5-498a-8759-0757d161f66e', 'e3c2ebec-0840-4086-be74-e9ddaf199ea6', 'e67bca0a-bb33-4323-ab52-86b4c5d6fae0', 'fa91e731-aca4-4d31-a773-20faf37c96b1'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:01 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-73db9d12-88d1-421f-a321-22d8294d1126 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 88380cfc-0181-4814-9b9e-f44fc554316d: deleted successfully
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:02 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Cloning volume 6c065315-766f-492b-b3da-43ecd1e13e1e to volume 065da9fa-aa71-4b3c-875c-04ea6cf55a48
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Creating offline snapshot 22f3bcde-4f13-440b-8391-1b7210b451d3 of volume 6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d56f4-3a59-4a27-ac89-d2d04c693822]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:02 devstack sudo[84650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:19:02 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-8c932f47-b62d-457f-b069-835aa1cab41f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-8c932f47-b62d-457f-b069-835aa1cab41f" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e2040-e04c-4b85-acdc-5d745784bf6d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:02 devstack sudo[84652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:19:02 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:03 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.709s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:03 devstack sudo[84664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 1G
Apr 13 11:19:03 devstack sudo[84664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:03 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.899s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:03 devstack sudo[84696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f
Apr 13 11:19:03 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 1G" returned: 0 in 0.707s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:03 devstack sudo[84664]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c065315-766f-492b-b3da-43ecd1e13e1e -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:03 devstack sudo[84698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c065315-766f-492b-b3da-43ecd1e13e1e -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3
Apr 13 11:19:03 devstack sudo[84698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:04 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8c932f47-b62d-457f-b069-835aa1cab41f" returned: 0 in 0.501s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-8c932f47-b62d-457f-b069-835aa1cab41f" released by "delete_volume" :: held 1.449s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['2b034b35-df56-4549-abf3-85111b4033ee'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:04 devstack cinder-volume[82099]: WARNING cinder.db.sqlalchemy.api [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-230528956']
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['bab9ef30-c52c-493c-9d70-63f625243a3f', '31db2ff7-e817-4092-af6b-a3df1dd4f7f8', 'f3b93044-4168-40a6-a17e-acbd76244c45', 'bb0f9ec3-58fa-4041-b6e0-982c489f65f2'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:04 devstack sudo[84704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:04 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:04 devstack sudo[84698]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c065315-766f-492b-b3da-43ecd1e13e1e -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3" returned: 0 in 0.794s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:04 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:04 devstack sudo[84706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3
Apr 13 11:19:04 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:05 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.648s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b35ad915-324e-458b-825a-6a5f38f38f94 tempest-GroupSnapshotsTest-1365298579 None] Delete group completed successfully.
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Flow 'volume_create_manager' (9e34a1fd-defd-455c-847a-29aa070c2ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4bc7bc-ab4b-4afd-8bc5-812ec15360b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4bc7bc-ab4b-4afd-8bc5-812ec15360b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-257808352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a69ee0d-49c0-4dec-9002-ed30a332f8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278fea809c334800b23eaba41d1d6020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:05Z,use_quota=True,user_id='66ab00ce55dc490c949c0941248bdf03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860a28d5-2ba9-42ba-9986-555bc92d4b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860a28d5-2ba9-42ba-9986-555bc92d4b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7bd477-fa20-4055-b3bc-5b0bb93d044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7bd477-fa20-4055-b3bc-5b0bb93d044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a69ee0d-49c0-4dec-9002-ed30a332f8d1', 'volume_name': 'volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a27e9d-b0ae-491b-b348-2b83e7ea8919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a27e9d-b0ae-491b-b348-2b83e7ea8919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b6122f-f48b-4e3e-a2d0-76f69a76589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1', 'volume_size': 1}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e233abd2-069d-4fd7-bcd6-d8f2b9c1fe7b tempest-GroupSnapshotsTest-1365298579 None] Group tempest-GroupSnapshotsTest-Group-1418967659: creating
Apr 13 11:19:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e233abd2-069d-4fd7-bcd6-d8f2b9c1fe7b tempest-GroupSnapshotsTest-1365298579 None] Group tempest-GroupSnapshotsTest-Group-1418967659: created successfully
Apr 13 11:19:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e233abd2-069d-4fd7-bcd6-d8f2b9c1fe7b tempest-GroupSnapshotsTest-1365298579 None] Create group completed successfully.
Apr 13 11:19:05 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3" returned: 0 in 0.818s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:05 devstack sudo[84710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info
Apr 13 11:19:05 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:05 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info" returned: 0 in 0.492s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:05 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:06 devstack sudo[84713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info
Apr 13 11:19:06 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:06 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.info" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Acquiring lock "cinder-quobyte-065da9fa-aa71-4b3c-875c-04ea6cf55a48" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-065da9fa-aa71-4b3c-875c-04ea6cf55a48" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] snapshot: 22f3bcde-4f13-440b-8391-1b7210b451d3, volume: 065da9fa-aa71-4b3c-875c-04ea6cf55a48,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d7a3b-ced0-4bee-848c-a0ccd841eca0]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:06 devstack sudo[84722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3
Apr 13 11:19:06 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (8e958779-2af4-4516-95f5-3f37c256b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca86ff7-2b0f-4e3c-baa3-a3efb721aca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca86ff7-2b0f-4e3c-baa3-a3efb721aca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2090427751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191db771-8c5d-4ec5-93b4-9db509e5aa50,host='devstack@QuobyteHD#QuobyteHD',id=685085c9-5244-4d5c-b72b-89b999f2bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:07Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2edfb38-1d92-40cd-8ed4-0e67e0abef77),volume_type_id=b2edfb38-1d92-40cd-8ed4-0e67e0abef77)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4bba57-de9e-4312-8f75-8f08b72e664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4bba57-de9e-4312-8f75-8f08b72e664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558aed51-4a53-4c1c-9d75-924992e2103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558aed51-4a53-4c1c-9d75-924992e2103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685085c9-5244-4d5c-b72b-89b999f2bb7b', 'volume_name': 'volume-685085c9-5244-4d5c-b72b-89b999f2bb7b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e071fb4-57fb-4755-886e-ac72684bb089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e071fb4-57fb-4755-886e-ac72684bb089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876f7225-9bdb-43fe-8cc2-b64c3492be27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:07 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Volume 685085c9-5244-4d5c-b72b-89b999f2bb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685085c9-5244-4d5c-b72b-89b999f2bb7b', 'volume_size': 1}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:07 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3" returned: 0 in 0.583s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c065315-766f-492b-b3da-43ecd1e13e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5a1b62-1718-4cb2-a8de-704fd6a6f447]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:07 devstack sudo[84727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:19:07 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:07 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.567s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:19:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:07 devstack sudo[84733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48
Apr 13 11:19:07 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:10 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48" returned: 0 in 2.893s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2627c2-8d25-4dd7-acf0-63e1f13c2146]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:10 devstack sudo[84751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:19:10 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:10 devstack sudo[84753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:10 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:11 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:11 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.674s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e, size 1024.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:19:11 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Converted 1024.00 MB image at 353.81 MB/s
Apr 13 11:19:11 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:11 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48
Apr 13 11:19:11 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:11 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48" returned: 0 in 0.479s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-065da9fa-aa71-4b3c-875c-04ea6cf55a48" released by "_copy_volume_from_snapshot" :: held 5.274s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Acquiring lock "cinder-quobyte-22f3bcde-4f13-440b-8391-1b7210b451d3" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-22f3bcde-4f13-440b-8391-1b7210b451d3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Deleting offline snapshot 22f3bcde-4f13-440b-8391-1b7210b451d3 of volume 6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] snapshot_file for this snap is: volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c26c9e-5cb1-4d21-b17f-508660035578]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:11 devstack sudo[84762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3
Apr 13 11:19:11 devstack sudo[84762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:12 devstack sudo[84762]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3" returned: 0 in 0.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c065315-766f-492b-b3da-43ecd1e13e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e54e79-1c5c-4000-923c-e9e0b8656537]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:12 devstack sudo[84767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:19:12 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:12 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.600s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:12 devstack sudo[84772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3
Apr 13 11:19:12 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:13 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3" returned: 0 in 0.677s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:13 devstack sudo[84811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3
Apr 13 11:19:13 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:14 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e.22f3bcde-4f13-440b-8391-1b7210b451d3" returned: 0 in 0.617s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-22f3bcde-4f13-440b-8391-1b7210b451d3" released by "_delete_snapshot" :: held 2.420s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.778s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.761s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-257808352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a69ee0d-49c0-4dec-9002-ed30a332f8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278fea809c334800b23eaba41d1d6020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:05Z,use_quota=True,user_id='66ab00ce55dc490c949c0941248bdf03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Creating volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:14 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:14 devstack sudo[84814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 1073741824
Apr 13 11:19:14 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f31bd8c3-38b0-46be-b057-29dae85a43c8 tempest-GroupsV314Test-63529380 None] Create group from source-group-5464b258-c5bb-410e-b268-a7f830d4418d completed successfully.
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Flow 'volume_create_manager' (421b9267-c7dc-435d-b983-7a190c51e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09caef1a-aa4a-4172-b4d4-050ba295abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:14 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 1073741824" returned: 0 in 0.695s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09caef1a-aa4a-4172-b4d4-050ba295abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629edfef-41c3-4021-88ff-348ad18255fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4b7ca641ef4408b5afe4b844cdda8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:15Z,use_quota=True,user_id='297889e32e50426fb2e44d8456133949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59c660e-71fc-463b-bce2-e1229e28a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59c660e-71fc-463b-bce2-e1229e28a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f3c09b-299d-4779-b93a-a6626328847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG cinder.image.glance [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Creating Keystone auth plugin from conf {{(pid=82099) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 11:19:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:14 devstack sudo[84822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1
Apr 13 11:19:14 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Acquiring lock "cinder-quobyte-065da9fa-aa71-4b3c-875c-04ea6cf55a48" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-065da9fa-aa71-4b3c-875c-04ea6cf55a48" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf09cbb-382b-4115-bc82-62d3e63459cd]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f3c09b-299d-4779-b93a-a6626328847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '629edfef-41c3-4021-88ff-348ad18255fb', 'volume_name': 'volume-629edfef-41c3-4021-88ff-348ad18255fb', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa501147e80>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0ba2c8-791c-4b0a-ad4d-d5bf2a670f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0ba2c8-791c-4b0a-ad4d-d5bf2a670f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1429f5-32fa-418c-a6ad-a4a86d345ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Volume 629edfef-41c3-4021-88ff-348ad18255fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-629edfef-41c3-4021-88ff-348ad18255fb', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa501147e80>}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Trying to clone 629edfef-41c3-4021-88ff-348ad18255fb from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]). {{(pid=82099) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 11:19:15 devstack sudo[84824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48
Apr 13 11:19:15 devstack sudo[84824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 11:19:15 devstack cinder-volume[82099]: INFO cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17e45d-7539-4635-9aaa-fb1edd51723e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:15 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" returned: 0 in 0.704s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.661s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=191db771-8c5d-4ec5-93b4-9db509e5aa50,created_at=2026-04-13T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2090427751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191db771-8c5d-4ec5-93b4-9db509e5aa50,host='devstack@QuobyteHD#QuobyteHD',id=685085c9-5244-4d5c-b72b-89b999f2bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:07Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2edfb38-1d92-40cd-8ed4-0e67e0abef77),volume_type_id=b2edfb38-1d92-40cd-8ed4-0e67e0abef77)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Creating volume 685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:15 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b6122f-f48b-4e3e-a2d0-76f69a76589d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfea053-3366-46f4-b006-c1f72ca11cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:15 devstack sudo[84849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b 1073741824
Apr 13 11:19:15 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:15 devstack sudo[84848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD
Apr 13 11:19:15 devstack sudo[84848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Volume volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 (8a69ee0d-49c0-4dec-9002-ed30a332f8d1): created successfully
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfea053-3366-46f4-b006-c1f72ca11cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Flow 'volume_create_manager' (9e34a1fd-defd-455c-847a-29aa070c2ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:15 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4fbafc4f-84d0-4dee-8a2c-1ec6986ebe92 tempest-SnapshotsActionsTest-1488247659 None] Created volume successfully.
Apr 13 11:19:15 devstack sudo[84824]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48" returned: 0 in 0.670s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:16 devstack sudo[84855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48
Apr 13 11:19:16 devstack sudo[84855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:16 devstack sudo[84848]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 is fetched for user 297889e32e50426fb2e44d8456133949. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93d176-a87f-47b3-bca7-199c9cc587e2]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:16 devstack sudo[84863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD
Apr 13 11:19:16 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:16 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b 1073741824" returned: 0 in 0.855s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:16 devstack sudo[84865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b
Apr 13 11:19:16 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:16 devstack sudo[84855]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-065da9fa-aa71-4b3c-875c-04ea6cf55a48" returned: 0 in 0.818s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-065da9fa-aa71-4b3c-875c-04ea6cf55a48" released by "delete_volume" :: held 1.561s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Created reservations ['506c2aab-ac36-46f2-884f-edf0b208b930'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:16 devstack cinder-volume[82099]: WARNING cinder.quota [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1409954177 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1409954177, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:16 devstack cinder-volume[82099]: WARNING cinder.quota [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1409954177 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1409954177, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:16 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Created reservations ['5f9a54e6-7cc3-493a-87f8-a84cecbe3957', 'e6d8ae74-1c93-4895-8190-8f134bee1aa5', '57ac865d-5a6e-46ea-b66e-7e3d1fa5729b', 'bdc01711-9156-4b6d-851a-48b059c80785'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:17 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:17 devstack sudo[84889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:17 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:17 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b" returned: 0 in 0.571s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.734s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876f7225-9bdb-43fe-8cc2-b64c3492be27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685085c9-5244-4d5c-b72b-89b999f2bb7b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81903de3-bd24-47c0-ae01-4bc7d91f6810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Creating offline snapshot 2cf81647-19ac-4b0a-9ed5-3d96a98d4867 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Volume volume-685085c9-5244-4d5c-b72b-89b999f2bb7b (685085c9-5244-4d5c-b72b-89b999f2bb7b): created successfully
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81903de3-bd24-47c0-ae01-4bc7d91f6810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (8e958779-2af4-4516-95f5-3f37c256b93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:17 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-23547ffe-3887-41a8-a0d0-ee520cf0af7c tempest-GroupSnapshotsTest-1365298579 None] Created volume successfully.
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5bc629-db77-4800-bc9f-c2ee66b76d72]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:17 devstack sudo[84891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1
Apr 13 11:19:17 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:17 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.446s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:17 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-91785bff-8f4f-4d88-aa74-455c1715dcbd tempest-GroupsV314Test-63529380 None] Delete group completed successfully.
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Acquiring lock "cinder-quobyte-6c065315-766f-492b-b3da-43ecd1e13e1e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-6c065315-766f-492b-b3da-43ecd1e13e1e" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5798d-2f4f-4805-b04f-5bb623a62a5b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:17 devstack sudo[84897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:19:17 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:17 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" returned: 0 in 0.603s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:17 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 1G
Apr 13 11:19:17 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:18 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.646s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:18 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 1G" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:18 devstack sudo[84909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e
Apr 13 11:19:18 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:18 devstack sudo[84911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:18 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (34e5bf03-8f52-4c0a-801f-60cdeac99ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66ed8e-b7ba-4c4d-97fa-29ce74717bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e66ed8e-b7ba-4c4d-97fa-29ce74717bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144714403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191db771-8c5d-4ec5-93b4-9db509e5aa50,host='devstack@QuobyteHD#QuobyteHD',id=2ebada1c-840a-431d-b027-fc4100be1d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:19Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2edfb38-1d92-40cd-8ed4-0e67e0abef77),volume_type_id=b2edfb38-1d92-40cd-8ed4-0e67e0abef77)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c5d1fe-a7fd-429a-88c8-10d4460208f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c5d1fe-a7fd-429a-88c8-10d4460208f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cbe4a2-6ef4-4c29-bbd5-b45c6f0a654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cbe4a2-6ef4-4c29-bbd5-b45c6f0a654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebada1c-840a-431d-b027-fc4100be1d1c', 'volume_name': 'volume-2ebada1c-840a-431d-b027-fc4100be1d1c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b13f1c8-0241-4c98-ac28-ba968f366fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b13f1c8-0241-4c98-ac28-ba968f366fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d3e236-9df1-4657-9a0f-211df4a67d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Volume 2ebada1c-840a-431d-b027-fc4100be1d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebada1c-840a-431d-b027-fc4100be1d1c', 'volume_size': 1}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:18 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6c065315-766f-492b-b3da-43ecd1e13e1e" returned: 0 in 0.529s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Lock "cinder-quobyte-6c065315-766f-492b-b3da-43ecd1e13e1e" released by "delete_volume" :: held 1.206s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:18 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.542s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:18 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 is being set with open permissions: ugo+rw
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:18 devstack sudo[84928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:18 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Created reservations ['2d811bb1-a480-4736-8a21-55dff5173ec6'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:18 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Created reservations ['27b4d8cd-ed1b-42ab-bf7d-6b67ba8849fb', '4b949ec8-4f19-4e0a-989c-f88a963ad282', '883a1994-7c61-4a90-b68b-750f02c79911', '8a5214ba-16aa-4292-9007-498854e3c1b8'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:19 devstack sudo[84930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:19 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:19 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.478s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:19 devstack sudo[84934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info
Apr 13 11:19:19 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:19 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8dc13916-b73e-4cfe-adea-e30b135b4473 tempest-GroupsV314Test-63529380 None] Delete group completed successfully.
Apr 13 11:19:19 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info" returned: 0 in 0.437s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:19 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info is being set with open permissions: ugo+rw
Apr 13 11:19:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:19 devstack sudo[84937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info
Apr 13 11:19:19 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:20 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.info" returned: 0 in 0.488s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.304s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629edfef-41c3-4021-88ff-348ad18255fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4b7ca641ef4408b5afe4b844cdda8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:15Z,use_quota=True,user_id='297889e32e50426fb2e44d8456133949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Creating volume 629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:20 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4fbd9a8e-ac66-445c-b86d-498e81965a4a tempest-SnapshotsActionsTest-1488247659 None] Create snapshot completed successfully
Apr 13 11:19:20 devstack sudo[84940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb 1073741824
Apr 13 11:19:20 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=132,cinder:UPDATE=155,cinder:INSERT=28,cinder:DELETE=5 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=157,cinder:UPDATE=130,cinder:DELETE=7,cinder:INSERT=33 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:21 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb 1073741824" returned: 0 in 0.786s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:21 devstack sudo[84958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:19:21 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:21 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 0 in 0.608s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=191db771-8c5d-4ec5-93b4-9db509e5aa50,created_at=2026-04-13T09:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144714403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=191db771-8c5d-4ec5-93b4-9db509e5aa50,host='devstack@QuobyteHD#QuobyteHD',id=2ebada1c-840a-431d-b027-fc4100be1d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:19Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2edfb38-1d92-40cd-8ed4-0e67e0abef77),volume_type_id=b2edfb38-1d92-40cd-8ed4-0e67e0abef77)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Creating volume 2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:21 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Attempting download of ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 629edfef-41c3-4021-88ff-348ad18255fb. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 11:19:21 devstack sudo[84961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c 1073741824
Apr 13 11:19:21 devstack sudo[84961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cecd43-64dd-4ca1-a727-4fd34290e952]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:21 devstack sudo[84963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13
Apr 13 11:19:21 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:22 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13" returned: 0 in 0.546s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:22 devstack sudo[84970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13
Apr 13 11:19:22 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:22 devstack sudo[84961]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c 1073741824" returned: 0 in 0.789s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:22 devstack sudo[84972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c
Apr 13 11:19:22 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:23 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13" returned: 1 in 0.651s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_7023sg13' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[36665368-97fc-47cf-bf84-dbf938200509]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:23 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD
Apr 13 11:19:23 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:23 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c" returned: 0 in 0.617s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.145s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Creating offline snapshot 14017605-fd9a-448c-88f5-755c45fec522 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d3e236-9df1-4657-9a0f-211df4a67d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebada1c-840a-431d-b027-fc4100be1d1c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d209900-6d15-496a-859a-8c83d43b7b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3504e-b5c7-4e0a-a277-52cc84481dbc]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:23 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Volume volume-2ebada1c-840a-431d-b027-fc4100be1d1c (2ebada1c-840a-431d-b027-fc4100be1d1c): created successfully
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d209900-6d15-496a-859a-8c83d43b7b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (34e5bf03-8f52-4c0a-801f-60cdeac99ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-28b967f9-0261-4b17-874a-4cb780d4f475 tempest-GroupSnapshotsTest-1365298579 None] Created volume successfully.
Apr 13 11:19:23 devstack sudo[84979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:23 devstack sudo[84979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:23 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] ffc1a9fa-e3a7-4577-9cbc-998b14363590 was qcow2, converting to raw {{(pid=82099) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 11:19:23 devstack sudo[84979]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.518s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:23 devstack sudo[84987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:19:23 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:23 devstack sudo[84989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 1G
Apr 13 11:19:23 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:24 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c42c1638-2363-46c5-a6c7-8a5f27cf80ca tempest-GroupSnapshotsTest-1365298579 None] Update group completed successfully.
Apr 13 11:19:24 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 1G" returned: 0 in 0.837s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:24 devstack sudo[85000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522
Apr 13 11:19:24 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:24 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 0 in 1.111s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:24 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_x1u7_33udevstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:19:24 devstack cinder-volume[82099]: INFO cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Converted 112.00 MB image at 100.66 MB/s
Apr 13 11:19:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:24 devstack sudo[85002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb 1G
Apr 13 11:19:24 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:25 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522" returned: 0 in 0.520s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:25 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 is being set with open permissions: ugo+rw
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:25 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522
Apr 13 11:19:25 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:25 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-383718d0-66d2-4a25-96ff-a40470e26b27 tempest-GroupSnapshotsTest-1365298579 None] Update group completed successfully.
Apr 13 11:19:25 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb 1G" returned: 0 in 0.584s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7295a6-9cda-4158-b024-dd8eb4f68782]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:25 devstack sudo[85012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:19:25 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:25 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522" returned: 0 in 0.669s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:25 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-87b01401-7943-42ad-ad0c-e0aeff33fc2e tempest-SnapshotsActionsTest-1488247659 None] Create snapshot completed successfully
Apr 13 11:19:26 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 0 in 0.637s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:26 devstack sudo[85017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:19:26 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-14017605-fd9a-448c-88f5-755c45fec522-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-14017605-fd9a-448c-88f5-755c45fec522-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-14017605-fd9a-448c-88f5-755c45fec522" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-14017605-fd9a-448c-88f5-755c45fec522" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Deleting offline snapshot 14017605-fd9a-448c-88f5-755c45fec522 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] snapshot_file for this snap is: volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d4ab4-8517-47d4-87bf-72b24ab58b55]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:26 devstack sudo[85019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522
Apr 13 11:19:26 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:26 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9367283f-c408-4061-9ace-be55323f0a85 tempest-GroupSnapshotsTest-1365298579 None] Update group completed successfully.
Apr 13 11:19:26 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 1 in 0.780s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:19:26 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Downloaded image ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 629edfef-41c3-4021-88ff-348ad18255fb successfully. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 for user 297889e32e50426fb2e44d8456133949 is deleted. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Marking volume 629edfef-41c3-4021-88ff-348ad18255fb as bootable. {{(pid=82099) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Copying metadata from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 to 629edfef-41c3-4021-88ff-348ad18255fb. {{(pid=82099) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Creating volume glance metadata for volume 629edfef-41c3-4021-88ff-348ad18255fb backed by image ffc1a9fa-e3a7-4577-9cbc-998b14363590 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82099) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1429f5-32fa-418c-a6ad-a4a86d345ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629edfef-41c3-4021-88ff-348ad18255fb', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa501147e80>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1781778c-9866-4cc0-a466-02b295e85d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:27 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Volume volume-629edfef-41c3-4021-88ff-348ad18255fb (629edfef-41c3-4021-88ff-348ad18255fb): created successfully
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1781778c-9866-4cc0-a466-02b295e85d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Flow 'volume_create_manager' (421b9267-c7dc-435d-b983-7a190c51e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-e2113488-3291-4e54-9d4c-85db5aa30ac3 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Created volume successfully.
Apr 13 11:19:27 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522" returned: 0 in 0.787s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[28819ef1-8e75-427b-bdd7-5cb4188ef842]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:27 devstack sudo[85028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:27 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c3fdd4f3-123d-48d0-bef4-babc093fca59 tempest-GroupSnapshotsTest-1365298579 None] Update group completed successfully.
Apr 13 11:19:27 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.575s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:27 devstack sudo[85033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522
Apr 13 11:19:27 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:28 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522" returned: 0 in 0.613s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:28 devstack sudo[85038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522
Apr 13 11:19:28 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] GroupSnapshot 53305c67-452b-4bdd-9e0b-8688de610441: creating.
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Group snapshot 53305c67-452b-4bdd-9e0b-8688de610441: creating. {{(pid=82099) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Creating offline snapshot 02c86662-1d78-4a80-9566-50b04865223c of volume 2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab00a5c-2e2e-46b1-bb04-44ba19609c01]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:29 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Flow 'volume_create_manager' (954741da-b87a-42b5-96cf-9274065ff651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e96f2a-4446-4d52-b6dc-3a0a53a22eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.14017605-fd9a-448c-88f5-755c45fec522" returned: 0 in 0.685s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:29 devstack sudo[85045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e96f2a-4446-4d52-b6dc-3a0a53a22eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1670507883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b2da79-ce16-4b84-a3e5-2985dfd5bf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0539ae92446418881551d6a7eb376b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:29Z,use_quota=True,user_id='ecde825b1c86426c8b41371545c1264a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:29 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341d3ff2-663c-48d1-b697-568bd6d13251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341d3ff2-663c-48d1-b697-568bd6d13251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fb7e8f-2e39-440b-b33a-f6a042e791c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fb7e8f-2e39-440b-b33a-f6a042e791c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b2da79-ce16-4b84-a3e5-2985dfd5bf41', 'volume_name': 'volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc48487-52d6-4683-8a6e-2aeb0a35e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc48487-52d6-4683-8a6e-2aeb0a35e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003b3d3b-9b60-4ab0-9ae1-008deeca2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:29 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Volume 95b2da79-ce16-4b84-a3e5-2985dfd5bf41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41', 'volume_size': 1}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-14017605-fd9a-448c-88f5-755c45fec522" released by "_delete_snapshot" :: held 2.819s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" released by "delete_snapshot" :: held 2.842s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:29 devstack cinder-volume[82099]: WARNING cinder.quota [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Created reservations ['b2a7e9af-0cc6-42ac-907a-e037dd0c7930', '9cc312ad-a652-4105-b88c-afa5a69e990c', 'e91eb404-9c9c-47a1-821d-e648abad64ce', '0eb7291c-4920-4b3e-a7cf-382feac77ca7'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Delete snapshot completed successfully.
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6324a024-f08c-4f71-876e-60c596c8081f tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-14017605-fd9a-448c-88f5-755c45fec522-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:29 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c" returned: 0 in 0.714s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:29 devstack sudo[85059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c 1G
Apr 13 11:19:29 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:30 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c 1G" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebada1c-840a-431d-b027-fc4100be1d1c -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:30 devstack sudo[85072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebada1c-840a-431d-b027-fc4100be1d1c -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c
Apr 13 11:19:30 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:30 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebada1c-840a-431d-b027-fc4100be1d1c -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:30 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:30 devstack sudo[85077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c
Apr 13 11:19:30 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:31 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:31 devstack sudo[85080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info
Apr 13 11:19:31 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:31 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info" returned: 0 in 0.426s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:31 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:31 devstack sudo[85083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info
Apr 13 11:19:31 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:32 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.info" returned: 0 in 0.413s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Creating offline snapshot 32d77cc9-cfc1-4d78-b637-a01078432ef0 of volume 685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0aa89a-e105-4a64-98dc-e70d28cf9cf4]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:32 devstack sudo[85086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b
Apr 13 11:19:32 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:32 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:32 devstack sudo[85091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 1G
Apr 13 11:19:32 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:33 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 1G" returned: 0 in 0.526s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685085c9-5244-4d5c-b72b-89b999f2bb7b -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:33 devstack sudo[85096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685085c9-5244-4d5c-b72b-89b999f2bb7b -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0
Apr 13 11:19:33 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:33 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685085c9-5244-4d5c-b72b-89b999f2bb7b -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0" returned: 0 in 0.453s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:33 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:33 devstack sudo[85101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0
Apr 13 11:19:33 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:34 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0" returned: 0 in 0.432s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:34 devstack sudo[85104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info
Apr 13 11:19:34 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:34 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:34 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:34 devstack sudo[85107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info
Apr 13 11:19:34 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:34 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.info" returned: 0 in 0.419s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.159s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Creating offline snapshot 3f6ee5e4-647b-430e-b24c-fdce5315c583 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb6b7b8-b27c-40b7-a2a4-b1f68d839559]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-62b97ca5-e167-4f99-914d-0d72405629dc tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 53305c67-452b-4bdd-9e0b-8688de610441: created successfully
Apr 13 11:19:35 devstack sudo[85110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:35 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 53305c67-452b-4bdd-9e0b-8688de610441: deleting
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 53305c67-452b-4bdd-9e0b-8688de610441: deleting {{(pid=82099) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-2ebada1c-840a-431d-b027-fc4100be1d1c" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-2ebada1c-840a-431d-b027-fc4100be1d1c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-02c86662-1d78-4a80-9566-50b04865223c" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-02c86662-1d78-4a80-9566-50b04865223c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Deleting offline snapshot 02c86662-1d78-4a80-9566-50b04865223c of volume 2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] snapshot_file for this snap is: volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170bf18-4b56-4fb1-bfd2-c9f4af1b2448]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:35 devstack sudo[85115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c
Apr 13 11:19:35 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:35 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.554s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:35 devstack sudo[85117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 1G
Apr 13 11:19:35 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:36 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c" returned: 0 in 0.557s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ebada1c-840a-431d-b027-fc4100be1d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e85c1a-e809-4ef8-8707-b64287d5136d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:36 devstack sudo[85125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c
Apr 13 11:19:36 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:36 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 1G" returned: 0 in 0.563s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:36 devstack sudo[85127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583
Apr 13 11:19:36 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:36 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c" returned: 0 in 0.488s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:36 devstack sudo[85135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c
Apr 13 11:19:36 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:36 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:36 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 is being set with open permissions: ugo+rw
Apr 13 11:19:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:36 devstack sudo[85137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583
Apr 13 11:19:36 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:37 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c" returned: 0 in 0.490s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:37 devstack sudo[85143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c
Apr 13 11:19:37 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:37 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583" returned: 0 in 0.499s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.684s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7e2ebd-6d86-4ad9-8130-fe277a061dd8]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9ebc39d5-fa68-4410-9f21-558d9b88f990 tempest-SnapshotsActionsTest-1488247659 None] Create snapshot completed successfully
Apr 13 11:19:37 devstack sudo[85145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:19:37 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:37 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c.02c86662-1d78-4a80-9566-50b04865223c" returned: 0 in 0.397s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-02c86662-1d78-4a80-9566-50b04865223c" released by "_delete_snapshot" :: held 1.993s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-2ebada1c-840a-431d-b027-fc4100be1d1c" released by "delete_snapshot" :: held 2.010s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-685085c9-5244-4d5c-b72b-89b999f2bb7b" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-685085c9-5244-4d5c-b72b-89b999f2bb7b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-32d77cc9-cfc1-4d78-b637-a01078432ef0" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-32d77cc9-cfc1-4d78-b637-a01078432ef0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Deleting offline snapshot 32d77cc9-cfc1-4d78-b637-a01078432ef0 of volume 685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] snapshot_file for this snap is: volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea2b61d-55d3-4b81-b9f9-457a981afd5b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:37 devstack sudo[85149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0
Apr 13 11:19:37 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:37 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:37 devstack sudo[85153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:19:37 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:38 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0" returned: 0 in 0.517s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-685085c9-5244-4d5c-b72b-89b999f2bb7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9f15d8-0f1d-4110-a61c-0750ff3e171c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:38 devstack sudo[85159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b
Apr 13 11:19:38 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:38 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 1 in 0.507s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.019s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.887s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1670507883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b2da79-ce16-4b84-a3e5-2985dfd5bf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0539ae92446418881551d6a7eb376b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:29Z,use_quota=True,user_id='ecde825b1c86426c8b41371545c1264a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Creating volume 95b2da79-ce16-4b84-a3e5-2985dfd5bf41 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:38 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-3f6ee5e4-647b-430e-b24c-fdce5315c583-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:38 devstack sudo[85164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 1073741824
Apr 13 11:19:38 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-3f6ee5e4-647b-430e-b24c-fdce5315c583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d', 'name': 'volume-629edfef-41c3-4021-88ff-348ad18255fb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd467e2fa-9726-4cf6-91e7-feb17c51c297', 'enforce_multipath': True} {{(pid=82099) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-3f6ee5e4-647b-430e-b24c-fdce5315c583" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-3f6ee5e4-647b-430e-b24c-fdce5315c583" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Deleting offline snapshot 3f6ee5e4-647b-430e-b24c-fdce5315c583 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] snapshot_file for this snap is: volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ec6ed-99f8-47ed-95d3-aab2282c447e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-f8eee0bf-1e74-41dd-8eaa-b775bcf683fa req-cbc3706b-7a28-4d61-bd98-b2b7263cf6c9 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] attachment_update completed successfully.
Apr 13 11:19:38 devstack sudo[85166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583
Apr 13 11:19:38 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:38 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b" returned: 0 in 0.595s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:38 devstack sudo[85174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0
Apr 13 11:19:38 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:38 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 1073741824" returned: 0 in 0.528s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:38 devstack sudo[85178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41
Apr 13 11:19:38 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:38 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583" returned: 0 in 0.531s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af497e8-a36b-4ab5-8651-ed8b7d1ca90a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:38 devstack sudo[85181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:38 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:39 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0" returned: 0 in 0.526s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:39 devstack sudo[85187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0
Apr 13 11:19:39 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:39 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003b3d3b-9b60-4ab0-9ae1-008deeca2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1730d6-94a3-4033-adb2-6f0b2d515f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:39 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Volume volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 (95b2da79-ce16-4b84-a3e5-2985dfd5bf41): created successfully
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1730d6-94a3-4033-adb2-6f0b2d515f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Flow 'volume_create_manager' (954741da-b87a-42b5-96cf-9274065ff651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:39 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c5a9b609-d71a-44b4-ad72-bb93d1582fbd tempest-VolumesServicesTestJSON-543654413 None] Created volume successfully.
Apr 13 11:19:39 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.539s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:39 devstack sudo[85192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583
Apr 13 11:19:39 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:39 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b.32d77cc9-cfc1-4d78-b637-a01078432ef0" returned: 0 in 0.406s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-32d77cc9-cfc1-4d78-b637-a01078432ef0" released by "_delete_snapshot" :: held 2.109s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-685085c9-5244-4d5c-b72b-89b999f2bb7b" released by "delete_snapshot" :: held 2.126s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:39 devstack cinder-volume[82099]: WARNING cinder.quota [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1478452920 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1478452920, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:39 devstack cinder-volume[82099]: WARNING cinder.quota [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1478452920 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1478452920, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['f30d2358-84dc-4daa-bd42-d36d64a49d54', '0d7b4a23-40e1-4e8d-9e69-6834df34e842', 'd87b5f28-839c-4387-b72f-5081ec403cf6', 'dc488cc1-3e9f-4045-8c60-7c2c38ad56b2'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['53d5a950-c569-4302-a7af-0f919a4b40df', '17d40678-c8c1-4156-8cbf-b7406697c78e', '7eb3dd0d-e292-4f6a-a92f-d468963c5f3e', '419a47d9-c85a-4975-ac36-a6701eb6cad2'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:39 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8e32d9f1-31b1-43e4-a12a-b845def33c1f tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 53305c67-452b-4bdd-9e0b-8688de610441: deleted successfully
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Acquiring lock "cinder-95b2da79-ce16-4b84-a3e5-2985dfd5bf41-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Lock "cinder-95b2da79-ce16-4b84-a3e5-2985dfd5bf41-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Acquiring lock "cinder-quobyte-95b2da79-ce16-4b84-a3e5-2985dfd5bf41" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Lock "cinder-quobyte-95b2da79-ce16-4b84-a3e5-2985dfd5bf41" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f93ab7-c149-49ac-82e6-ca21c7f94f3d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:39 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583" returned: 0 in 0.533s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:39 devstack sudo[85199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583
Apr 13 11:19:39 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:39 devstack sudo[85198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41
Apr 13 11:19:39 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:40 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.3f6ee5e4-647b-430e-b24c-fdce5315c583" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-3f6ee5e4-647b-430e-b24c-fdce5315c583" released by "_delete_snapshot" :: held 2.134s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" released by "delete_snapshot" :: held 2.165s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:40 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41" returned: 0 in 0.529s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:40 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41
Apr 13 11:19:40 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Created reservations ['8d988c6f-5705-4196-8328-b2781a6d2e54', 'f920b07d-7e51-415d-b42e-fe2e81ea63da', 'fa3dd498-5c2f-4587-a187-bdd921629a1b', '66941155-bda0-4a66-8103-e721a70bc4ba'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Delete snapshot completed successfully.
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-17bc7c39-1143-4025-9eca-436f695345ca tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-3f6ee5e4-647b-430e-b24c-fdce5315c583-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:40 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-95b2da79-ce16-4b84-a3e5-2985dfd5bf41" returned: 0 in 0.416s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Lock "cinder-quobyte-95b2da79-ce16-4b84-a3e5-2985dfd5bf41" released by "delete_volume" :: held 0.979s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Created reservations ['1dfe8413-154b-4efe-87f5-324ac56ee720', '029a466c-8c5a-463e-8db7-b3fc16e8ad80', '5946d49e-a79b-42a1-b039-7a858ae34d55', '49a3a7db-4a5b-42a4-9b26-0472cbc5160e'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:40 devstack sudo[85209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:40 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-2ebada1c-840a-431d-b027-fc4100be1d1c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-2ebada1c-840a-431d-b027-fc4100be1d1c" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b76bae-78b5-4ba0-942e-1b269e611020]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:41 devstack sudo[85211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c
Apr 13 11:19:41 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:41 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.569s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:41 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Deleted volume successfully.
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Creating offline snapshot 70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4f1815d3-d0fb-4089-bd13-975de6508b57 tempest-VolumesServicesTestJSON-543654413 None] Lock "cinder-95b2da79-ce16-4b84-a3e5-2985dfd5bf41-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dbb58b-8b13-40fc-a7c5-88d8baedbc34]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:41 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c" returned: 0 in 0.616s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:41 devstack sudo[85221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c
Apr 13 11:19:41 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:41 devstack sudo[85220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:41 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:42 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ebada1c-840a-431d-b027-fc4100be1d1c" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-2ebada1c-840a-431d-b027-fc4100be1d1c" released by "delete_volume" :: held 1.110s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-685085c9-5244-4d5c-b72b-89b999f2bb7b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-685085c9-5244-4d5c-b72b-89b999f2bb7b" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed2e135-b883-4ff8-9e61-f39b68624c32]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:42 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.664s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:42 devstack sudo[85230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b
Apr 13 11:19:42 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:42 devstack sudo[85231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c 1G
Apr 13 11:19:42 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:42 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b" returned: 0 in 0.635s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:42 devstack sudo[85261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b
Apr 13 11:19:42 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:43 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c 1G" returned: 0 in 0.784s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:43 devstack sudo[85265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c
Apr 13 11:19:43 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:43 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-685085c9-5244-4d5c-b72b-89b999f2bb7b" returned: 0 in 0.698s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-685085c9-5244-4d5c-b72b-89b999f2bb7b" released by "delete_volume" :: held 1.377s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['b370b435-3a5d-4d52-9e33-84c615529e9b'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:43 devstack cinder-volume[82099]: WARNING cinder.quota [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1478452920 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1478452920, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['ff12ac68-a39d-4da1-a12d-91c014b4f14b', '69229abd-0d58-44df-9baf-4b79d49492f9', '060abe0e-0000-456a-846c-033fb7cf9a4a', '4c7b32fe-4534-429d-bde5-9b3b39f1d3cf'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['8293c39d-e115-4d46-9f07-4e5a4deaffd1', 'aad0dc02-8265-4c67-a7bd-fdb7eb1d4fce', 'c76e74dc-91e4-46eb-9d70-53647e8282de', '5d0474c7-5bb9-4396-9db0-b3a80547394a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:43 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" returned: 0 in 0.923s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:43 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c is being set with open permissions: ugo+rw
Apr 13 11:19:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:43 devstack sudo[85275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:43 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:44 devstack sudo[85276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c
Apr 13 11:19:44 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:44 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.673s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:44 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-127da908-a5e9-4fdc-994e-92e1d06f9b7f tempest-GroupSnapshotsTest-1365298579 None] Delete group completed successfully.
Apr 13 11:19:44 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" returned: 0 in 0.826s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.289s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-748eb77e-7514-440c-81de-b2fa0bcbd52c tempest-SnapshotsActionsTest-1488247659 None] Create snapshot completed successfully
Apr 13 11:19:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c06405dc-be81-4785-95aa-67bc152fca6d tempest-GroupSnapshotsTest-1365298579 None] Group tempest-GroupSnapshotsTest-Group-992312076: creating
Apr 13 11:19:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c06405dc-be81-4785-95aa-67bc152fca6d tempest-GroupSnapshotsTest-1365298579 None] Group tempest-GroupSnapshotsTest-Group-992312076: created successfully
Apr 13 11:19:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c06405dc-be81-4785-95aa-67bc152fca6d tempest-GroupSnapshotsTest-1365298579 None] Create group completed successfully.
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Flow 'volume_create_manager' (84783642-89db-4678-b920-b20b966bbf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5016be-4e01-428b-9afc-ca62e1c73feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5016be-4e01-428b-9afc-ca62e1c73feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1490157612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f480699-afa1-4dfa-a6e8-064e46bb27b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4233a3c2164d16a645349e5772a16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:45Z,use_quota=True,user_id='dea2930bb55c47a8bc16f43e55068557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbd8ef4-5c59-45c6-b166-04dcbf5f1bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbd8ef4-5c59-45c6-b166-04dcbf5f1bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1715585a-3c3d-4940-bdf7-7a24b8069b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.image.glance [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Creating Keystone auth plugin from conf {{(pid=82099) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1715585a-3c3d-4940-bdf7-7a24b8069b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f480699-afa1-4dfa-a6e8-064e46bb27b6', 'volume_name': 'volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa5011c65f0>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35d7866-f762-488e-bc70-8684664545cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35d7866-f762-488e-bc70-8684664545cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31310bf5-ea3e-48ff-8457-eb9d2a2aa5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:45 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Volume 5f480699-afa1-4dfa-a6e8-064e46bb27b6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa5011c65f0>}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Trying to clone 5f480699-afa1-4dfa-a6e8-064e46bb27b6 from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]). {{(pid=82099) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 11:19:45 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa03b9c5-a82d-426f-abc5-7e3bcca50687]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:45 devstack sudo[85283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD
Apr 13 11:19:45 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Deleting offline snapshot 70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] snapshot_file for this snap is: volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e9b82-f199-427a-8091-00ba65bf428b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:46 devstack sudo[85285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c
Apr 13 11:19:46 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:46 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD" returned: 0 in 0.634s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 is fetched for user dea2930bb55c47a8bc16f43e55068557. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3131c3a-39b1-4b0d-9f3f-94d9d84a5798]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:46 devstack sudo[85290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD
Apr 13 11:19:46 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (9cdacd8a-c027-44de-ac93-e5e6ef267977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c0f40f-e2e7-466a-adc9-110a0b9cd92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c0f40f-e2e7-466a-adc9-110a0b9cd92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922444430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a4dc6f09-f2bb-4c6c-aa21-62a83f9886a7,host='devstack@QuobyteHD#QuobyteHD',id=a09230ff-eeda-4152-a1e3-068a7c562881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:46Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0295b66b-8ffa-4c7b-ae10-81d7e82c0efa),volume_type_id=0295b66b-8ffa-4c7b-ae10-81d7e82c0efa)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5ad7de-9e3f-4346-abb5-3858196173dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5ad7de-9e3f-4346-abb5-3858196173dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2d38b3-1642-4a3f-93ad-295655fc331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2d38b3-1642-4a3f-93ad-295655fc331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09230ff-eeda-4152-a1e3-068a7c562881', 'volume_name': 'volume-a09230ff-eeda-4152-a1e3-068a7c562881', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79374e6-6912-425b-8e4e-c05c1986b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79374e6-6912-425b-8e4e-c05c1986b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff6a2b7-2231-4687-8dbb-8ca568172730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:46 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Volume a09230ff-eeda-4152-a1e3-068a7c562881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09230ff-eeda-4152-a1e3-068a7c562881', 'volume_size': 1}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a4dc6f09-f2bb-4c6c-aa21-62a83f9886a7,created_at=2026-04-13T09:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922444430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a4dc6f09-f2bb-4c6c-aa21-62a83f9886a7,host='devstack@QuobyteHD#QuobyteHD',id=a09230ff-eeda-4152-a1e3-068a7c562881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65cb1792981e44a6b5bef9a127cdcd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:46Z,use_quota=True,user_id='f39ea6edbc3b4c7ab9874c91b6cc1b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0295b66b-8ffa-4c7b-ae10-81d7e82c0efa),volume_type_id=0295b66b-8ffa-4c7b-ae10-81d7e82c0efa)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Creating volume a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:46 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:46 devstack sudo[85293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 1073741824
Apr 13 11:19:46 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:46 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" returned: 0 in 0.802s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0715dfe-12cd-4ee5-8ed9-f696f8849713]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:46 devstack sudo[85298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:46 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:46 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:47 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 1073741824" returned: 0 in 0.611s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:47 devstack sudo[85309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881
Apr 13 11:19:47 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:47 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.505s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:47 devstack sudo[85312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c
Apr 13 11:19:47 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:47 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881" returned: 0 in 0.421s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1490157612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f480699-afa1-4dfa-a6e8-064e46bb27b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4233a3c2164d16a645349e5772a16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:19:45Z,use_quota=True,user_id='dea2930bb55c47a8bc16f43e55068557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Creating volume 5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:19:47 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff6a2b7-2231-4687-8dbb-8ca568172730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09230ff-eeda-4152-a1e3-068a7c562881', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:47 devstack sudo[85316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 1073741824
Apr 13 11:19:47 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b891a0a3-68eb-453f-acc6-305bd29f9153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:47 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Volume volume-a09230ff-eeda-4152-a1e3-068a7c562881 (a09230ff-eeda-4152-a1e3-068a7c562881): created successfully
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b891a0a3-68eb-453f-acc6-305bd29f9153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Flow 'volume_create_manager' (9cdacd8a-c027-44de-ac93-e5e6ef267977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:47 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-33e9dad6-c1c5-45a5-b3ea-c7523eaf5cdb tempest-GroupSnapshotsTest-1365298579 None] Created volume successfully.
Apr 13 11:19:47 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" returned: 0 in 0.542s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:47 devstack sudo[85320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c
Apr 13 11:19:47 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:48 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 1073741824" returned: 0 in 0.651s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:48 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c" released by "_delete_snapshot" :: held 2.433s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" released by "delete_snapshot" :: held 2.452s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:48 devstack sudo[85326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:48 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Created reservations ['3f4491c9-9752-47c6-ba1e-8d7d11565b56', 'b25cd7d6-8757-461f-b1f5-2baccba9198d', '52845916-5ede-4518-a17d-0159fbdaef8c', '59847b3f-902e-4b70-8939-4f145c71ea5c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Delete snapshot completed successfully.
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3200b6a-60ee-4ea1-94ae-f447b5a24e26 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-70fd4c6d-e8e7-4beb-b9eb-d211fda2e84c-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] GroupSnapshot 7cc35ca3-3645-42b9-842d-072df658033f: creating.
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Group snapshot 7cc35ca3-3645-42b9-842d-072df658033f: creating. {{(pid=82099) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:48 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 0 in 0.469s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.137s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Attempting download of ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 5f480699-afa1-4dfa-a6e8-064e46bb27b6. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Creating offline snapshot df94020d-530a-4daa-8d9f-a7e06645bd43 of volume a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deb8f89-ac14-4a85-bcc3-745ef38027dd]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c687af7a-27a6-45cb-b3b7-7cd319ea647e]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:49 devstack sudo[85329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881
Apr 13 11:19:49 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:49 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7
Apr 13 11:19:49 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:49 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881" returned: 0 in 0.620s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:49 devstack sudo[85338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 1G
Apr 13 11:19:49 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:49 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7" returned: 0 in 0.669s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:49 devstack sudo[85340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7
Apr 13 11:19:49 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:50 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 1G" returned: 0 in 0.501s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a09230ff-eeda-4152-a1e3-068a7c562881 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:50 devstack sudo[85347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a09230ff-eeda-4152-a1e3-068a7c562881 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43
Apr 13 11:19:50 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:50 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7" returned: 1 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_10gwwfj7' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebf8895-55f0-4415-82ba-dfbe78988c12]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:50 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD
Apr 13 11:19:50 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:50 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a09230ff-eeda-4152-a1e3-068a7c562881 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43" returned: 0 in 0.572s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:50 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:50 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43
Apr 13 11:19:50 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:50 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] ffc1a9fa-e3a7-4577-9cbc-998b14363590 was qcow2, converting to raw {{(pid=82099) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 11:19:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:50 devstack sudo[85384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:50 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:51 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:51 devstack sudo[85388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info
Apr 13 11:19:51 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:51 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info" returned: 0 in 0.521s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:51 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:51 devstack sudo[85404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info
Apr 13 11:19:51 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:51 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 0 in 0.971s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_9aqif7_vdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:19:51 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Converted 112.00 MB image at 112.00 MB/s
Apr 13 11:19:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:51 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 1G
Apr 13 11:19:51 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:52 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.info" returned: 0 in 0.457s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.192s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.581s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Creating offline snapshot 70593017-fbac-4b61-936e-eb77bfd9e091 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f95e5f8-0715-40d6-9ba2-64154ca40762]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:52 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0e62569d-e3e7-4b96-851b-23979524b5e7 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 7cc35ca3-3645-42b9-842d-072df658033f: created successfully
Apr 13 11:19:52 devstack sudo[85423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:52 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:52 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 1G" returned: 0 in 0.585s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb9c690-d2f4-4d50-ab66-6ea461182f68]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:52 devstack sudo[85433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:52 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:52 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.629s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:52 devstack sudo[85441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 1G
Apr 13 11:19:52 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:52 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 0 in 0.556s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:53 devstack sudo[85443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:53 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:53 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 7cc35ca3-3645-42b9-842d-072df658033f: deleting
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 7cc35ca3-3645-42b9-842d-072df658033f: deleting {{(pid=82099) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-a09230ff-eeda-4152-a1e3-068a7c562881" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-a09230ff-eeda-4152-a1e3-068a7c562881" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-df94020d-530a-4daa-8d9f-a7e06645bd43" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-df94020d-530a-4daa-8d9f-a7e06645bd43" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Deleting offline snapshot df94020d-530a-4daa-8d9f-a7e06645bd43 of volume a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] snapshot_file for this snap is: volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[76184d7a-0962-43b7-82ec-698c9d9be34f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:53 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43
Apr 13 11:19:53 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:53 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 1G" returned: 0 in 0.704s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:53 devstack sudo[85453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091
Apr 13 11:19:53 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:53 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 1 in 0.695s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Downloaded image ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 5f480699-afa1-4dfa-a6e8-064e46bb27b6 successfully. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 for user dea2930bb55c47a8bc16f43e55068557 is deleted. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Marking volume 5f480699-afa1-4dfa-a6e8-064e46bb27b6 as bootable. {{(pid=82099) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Copying metadata from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 to 5f480699-afa1-4dfa-a6e8-064e46bb27b6. {{(pid=82099) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Creating volume glance metadata for volume 5f480699-afa1-4dfa-a6e8-064e46bb27b6 backed by image ffc1a9fa-e3a7-4577-9cbc-998b14363590 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82099) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31310bf5-ea3e-48ff-8457-eb9d2a2aa5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa5011c65f0>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eea7ded-a00c-4d46-a813-ccf5f535bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:19:53 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Volume volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 (5f480699-afa1-4dfa-a6e8-064e46bb27b6): created successfully
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eea7ded-a00c-4d46-a813-ccf5f535bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Flow 'volume_create_manager' (84783642-89db-4678-b920-b20b966bbf87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:19:53 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-14603986-ed94-4e59-bdf6-1c6bf57bff00 tempest-VolumesImageMetadata-293517243 None] Created volume successfully.
Apr 13 11:19:53 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43" returned: 0 in 0.672s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a09230ff-eeda-4152-a1e3-068a7c562881(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea5e483-3ae6-465c-8569-8a40946e5fcf]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:53 devstack sudo[85458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881
Apr 13 11:19:53 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:54 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091" returned: 0 in 0.536s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:54 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 is being set with open permissions: ugo+rw
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:54 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091
Apr 13 11:19:54 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:54 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881" returned: 0 in 0.531s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:54 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43
Apr 13 11:19:54 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:54 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091" returned: 0 in 0.464s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.406s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f81524f1-d500-4e61-a3be-9a7042b38df0 tempest-SnapshotsActionsTest-1488247659 None] Create snapshot completed successfully
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-70593017-fbac-4b61-936e-eb77bfd9e091-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-70593017-fbac-4b61-936e-eb77bfd9e091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Acquiring lock "cinder-quobyte-70593017-fbac-4b61-936e-eb77bfd9e091" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-70593017-fbac-4b61-936e-eb77bfd9e091" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Deleting offline snapshot 70593017-fbac-4b61-936e-eb77bfd9e091 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] snapshot_file for this snap is: volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[501f5100-0921-4c86-8014-b8388fdf80b1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:54 devstack sudo[85475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091
Apr 13 11:19:54 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Acquiring lock "cinder-5f480699-afa1-4dfa-a6e8-064e46bb27b6-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Lock "cinder-5f480699-afa1-4dfa-a6e8-064e46bb27b6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:54 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43" returned: 0 in 0.567s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:55 devstack sudo[85477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43
Apr 13 11:19:55 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Acquiring lock "cinder-quobyte-5f480699-afa1-4dfa-a6e8-064e46bb27b6" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Lock "cinder-quobyte-5f480699-afa1-4dfa-a6e8-064e46bb27b6" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31061d-4b06-4a17-992f-d9e4ac2e5257]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:55 devstack sudo[85479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:55 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:55 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091" returned: 0 in 0.516s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab27929-853e-49c8-afab-130aa66cff8d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:55 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881.df94020d-530a-4daa-8d9f-a7e06645bd43" returned: 0 in 0.477s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-df94020d-530a-4daa-8d9f-a7e06645bd43" released by "_delete_snapshot" :: held 2.322s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:55 devstack sudo[85485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:55 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-a09230ff-eeda-4152-a1e3-068a7c562881" released by "delete_snapshot" :: held 2.340s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:55 devstack cinder-volume[82099]: WARNING cinder.quota [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1051734906 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1051734906, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:55 devstack cinder-volume[82099]: WARNING cinder.quota [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1051734906 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1051734906, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['e7da9f2c-9445-4347-b7c5-851e27f906b9', '2923098a-59c9-41dd-9789-40cb99f28db5', 'bb170f10-65a0-4a9e-a3dd-ce0ae6230808', 'f18fbd38-b270-4dab-9f6e-659fbeb9dc39'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:55 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7509b530-2266-436e-9166-5ac02cb86298 tempest-GroupSnapshotsTest-1365298579 None] group_snapshot 7cc35ca3-3645-42b9-842d-072df658033f: deleted successfully
Apr 13 11:19:55 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 0 in 0.552s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:55 devstack sudo[85489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:55 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:55 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.572s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:55 devstack sudo[85495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091
Apr 13 11:19:55 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:56 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 1 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:56 devstack sudo[85500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6
Apr 13 11:19:56 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:56 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091" returned: 0 in 0.690s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:56 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5f480699-afa1-4dfa-a6e8-064e46bb27b6" returned: 0 in 0.623s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:56 devstack sudo[85545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091
Apr 13 11:19:56 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Lock "cinder-quobyte-5f480699-afa1-4dfa-a6e8-064e46bb27b6" released by "delete_volume" :: held 1.769s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Created reservations ['14c7fd18-1a56-4886-97bd-dbf26a17c5af', '4f30e725-666d-427f-ad9b-472ad598d134', '88380be4-7216-4581-b967-3a6bc71cc656', 'c511dfc6-e424-418d-9bba-2fcf43b9e39a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "cinder-quobyte-a09230ff-eeda-4152-a1e3-068a7c562881" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:57 devstack sudo[85549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:57 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-a09230ff-eeda-4152-a1e3-068a7c562881" acquired by "delete_volume" :: waited 0.056s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5d0a3f-483d-499b-a56e-7b52f3505a99]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:57 devstack sudo[85551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881
Apr 13 11:19:57 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:57 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.70593017-fbac-4b61-936e-eb77bfd9e091" returned: 0 in 0.991s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-70593017-fbac-4b61-936e-eb77bfd9e091" released by "_delete_snapshot" :: held 2.837s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" released by "delete_snapshot" :: held 2.854s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Created reservations ['21863ef1-9621-45ab-af6c-945a5d9cfa64', '391927df-37b5-474a-a7ba-3be925b5123c', '560ead4e-fa68-46b4-a875-f6f453d2072d', '44ef0079-941f-4b98-9915-a777de83cf84'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:57 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Delete snapshot completed successfully.
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0e8dacf6-9227-468c-9e54-3a2b89698733 tempest-SnapshotsActionsTest-256520426 None] Lock "cinder-70593017-fbac-4b61-936e-eb77bfd9e091-delete_snapshot" released by "delete_snapshot" :: held 2.956s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:57 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:57 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.824s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881" returned: 0 in 0.650s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:57 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Deleted volume successfully.
Apr 13 11:19:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b207ac2a-41e4-43bb-b6c9-76d1ca2f1476 tempest-VolumesImageMetadata-293517243 None] Lock "cinder-5f480699-afa1-4dfa-a6e8-064e46bb27b6-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:57 devstack sudo[85560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881
Apr 13 11:19:57 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "cinder-2cf81647-19ac-4b0a-9ed5-3d96a98d4867-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-2cf81647-19ac-4b0a-9ed5-3d96a98d4867-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "cinder-quobyte-2cf81647-19ac-4b0a-9ed5-3d96a98d4867" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-quobyte-2cf81647-19ac-4b0a-9ed5-3d96a98d4867" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Deleting offline snapshot 2cf81647-19ac-4b0a-9ed5-3d96a98d4867 of volume 8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] snapshot_file for this snap is: volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2f00d1-ad1a-4f28-bbf0-32a736e2be75]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:58 devstack sudo[85563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:19:58 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:58 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a09230ff-eeda-4152-a1e3-068a7c562881" returned: 0 in 0.835s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Lock "cinder-quobyte-a09230ff-eeda-4152-a1e3-068a7c562881" released by "delete_volume" :: held 1.593s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['b36f1cde-3a67-4878-bd2e-5f4bc427908c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:58 devstack cinder-volume[82099]: WARNING cinder.quota [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1051734906 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1051734906, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Created reservations ['591f3c4e-cbf2-4944-b2dd-d08e225cd9fd', '63ffec9f-0522-478f-9325-f601861dc0ca', 'a4fe6d01-93c6-406e-80f2-19cbf87e5a14', '26e6e620-a710-4b71-ace0-4b3a66b72630'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:19:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:59 devstack sudo[85567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:19:59 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:59 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.783s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:19:59 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110daad-49ca-477f-93b3-9bd5398ca5b6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:19:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:19:59 devstack sudo[85572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1
Apr 13 11:19:59 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:19:59 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root
Apr 13 11:19:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.567s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:19:59 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:19:59 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-cd4c73ee-d488-4052-a5f1-970615ba9849 tempest-GroupSnapshotsTest-1365298579 None] Delete group completed successfully.
Apr 13 11:20:00 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" returned: 0 in 0.699s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:00 devstack sudo[85578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:20:00 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:00 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.597s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:00 devstack sudo[85583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867
Apr 13 11:20:00 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:01 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1.2cf81647-19ac-4b0a-9ed5-3d96a98d4867" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-quobyte-2cf81647-19ac-4b0a-9ed5-3d96a98d4867" released by "_delete_snapshot" :: held 2.753s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" released by "delete_snapshot" :: held 2.767s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Created reservations ['5eed5964-357f-423c-94c5-d7a8cbd5ca35', '3b4792a7-1563-4734-80b9-b78cc066f6a2', '3edb194d-8a0a-4d7a-89cf-14dbed89232f', 'b4d48633-e6a2-4eca-85f7-dc8d02273f2c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:01 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Delete snapshot completed successfully.
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-910aec0a-aba0-42dd-a09b-22652ca89aee tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-2cf81647-19ac-4b0a-9ed5-3d96a98d4867-delete_snapshot" released by "delete_snapshot" :: held 2.894s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "cinder-8a69ee0d-49c0-4dec-9002-ed30a332f8d1-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-8a69ee0d-49c0-4dec-9002-ed30a332f8d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c92d12-8831-4aad-8409-4840be064d73]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:01 devstack sudo[85588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1
Apr 13 11:20:01 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:02 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" returned: 0 in 0.662s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:02 devstack sudo[85618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1
Apr 13 11:20:02 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Flow 'volume_create_manager' (f44cbe93-d12b-40aa-ba05-d5dba2defe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90b7fff-3379-48d3-a784-b63c91dd4e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90b7fff-3379-48d3-a784-b63c91dd4e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1601973128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bfa7f4ea7142c2bce371f75a595cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:03Z,use_quota=True,user_id='e464d640266b4efab80678a04eddc81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da0e9ef-5a5e-441d-9f3c-0ad47bc32f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da0e9ef-5a5e-441d-9f3c-0ad47bc32f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d332139-7a86-46c0-a17b-129e06a4bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d332139-7a86-46c0-a17b-129e06a4bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e', 'volume_name': 'volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f377ed-0980-473b-866f-1a4b899443ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f377ed-0980-473b-866f-1a4b899443ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520bd3bc-7ef5-479d-a975-1cf3faa86a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:02 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Volume d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e', 'volume_size': 1}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1601973128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bfa7f4ea7142c2bce371f75a595cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:03Z,use_quota=True,user_id='e464d640266b4efab80678a04eddc81b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Creating volume d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:02 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:02 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e 1073741824
Apr 13 11:20:02 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:03 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" returned: 0 in 0.825s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-quobyte-8a69ee0d-49c0-4dec-9002-ed30a332f8d1" released by "delete_volume" :: held 1.566s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Created reservations ['f7ded26e-656e-44e7-b7d2-71d3fd579c12', '32a1e4b4-df77-44a6-b0db-a22b6116dcfa', '684bad48-3fda-4864-a0de-0d4336c9bad0', '0e0dbdff-d640-4306-8d91-8140714486cd'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:03 devstack sudo[85645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:03 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:03 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e 1073741824" returned: 0 in 1.116s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:03 devstack sudo[85651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e
Apr 13 11:20:03 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:04 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.625s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Deleted volume successfully.
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc52d7c8-2c7c-44a7-bfaa-a92d0de73b76 tempest-SnapshotsActionsTest-1488247659 None] Lock "cinder-8a69ee0d-49c0-4dec-9002-ed30a332f8d1-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:04 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e" returned: 0 in 0.672s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520bd3bc-7ef5-479d-a975-1cf3faa86a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f805977f-ed8d-4adc-a7de-51a677d31499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:04 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Volume volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e (d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e): created successfully
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f805977f-ed8d-4adc-a7de-51a677d31499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Flow 'volume_create_manager' (f44cbe93-d12b-40aa-ba05-d5dba2defe4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-19b91686-a165-44d4-81a4-ba5dba0d2861 tempest-VolumesMetadataTest-754055157 None] Created volume successfully.
Apr 13 11:20:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Acquiring lock "cinder-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Lock "cinder-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Acquiring lock "cinder-quobyte-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Lock "cinder-quobyte-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[71708bb9-66f5-471e-aecf-4166e9d43049]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:05 devstack sudo[85661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e
Apr 13 11:20:05 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:06 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e" returned: 0 in 0.641s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:06 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e
Apr 13 11:20:06 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:06 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e" returned: 0 in 0.534s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Lock "cinder-quobyte-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e" released by "delete_volume" :: held 1.254s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Created reservations ['cc1f5be8-5792-41ac-812e-2e320ad2819e', '523d3da6-dcdf-49b4-9571-77154554fdf0', '955461b6-db4a-459f-91ae-14e0c953a3ac', '7be60dba-0ec7-46b2-8b74-dd8b7f4c118c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:07 devstack sudo[85692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:07 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:07 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.610s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:07 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Deleted volume successfully.
Apr 13 11:20:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a48cb9cc-882a-4722-8666-477c1e8eabc7 tempest-VolumesMetadataTest-754055157 None] Lock "cinder-d77d2614-b8bc-46a2-9f2f-e2e6a83d6e6e-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-d8692482-6738-4b7f-94c6-a92237dfb5d5 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Terminate volume connection completed successfully.
Apr 13 11:20:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-d8692482-6738-4b7f-94c6-a92237dfb5d5 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Deleting attachment d467e2fa-9726-4cf6-91e7-feb17c51c297. {{(pid=82099) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 11:20:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "cinder-629edfef-41c3-4021-88ff-348ad18255fb-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-629edfef-41c3-4021-88ff-348ad18255fb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "cinder-quobyte-629edfef-41c3-4021-88ff-348ad18255fb" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-quobyte-629edfef-41c3-4021-88ff-348ad18255fb" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd2d86f-0d80-46d7-ada6-84b7de8ea656]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:09 devstack sudo[85698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:20:09 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Flow 'volume_create_manager' (ed786e37-31a2-4f92-b17d-8745e28cfff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:10 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b480ced2-4a51-4be4-92ef-1c5b653393a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b480ced2-4a51-4be4-92ef-1c5b653393a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1567857927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9998553e-d275-4c39-b3bb-e655180664e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c99aa3ba7e4380b3ed12d065bbd95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:10Z,use_quota=True,user_id='95539f25fbae4f7d8bde55dff15a524b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5a1e4f-80bc-4343-a20d-aa973f9dbc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5a1e4f-80bc-4343-a20d-aa973f9dbc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c49a409-b470-477a-8bad-442c3394d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c49a409-b470-477a-8bad-442c3394d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9998553e-d275-4c39-b3bb-e655180664e6', 'volume_name': 'volume-9998553e-d275-4c39-b3bb-e655180664e6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96978170-bd77-4196-b040-348a73f6391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96978170-bd77-4196-b040-348a73f6391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fab0a0-807d-4f56-93b5-453926d3603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:10 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Volume 9998553e-d275-4c39-b3bb-e655180664e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9998553e-d275-4c39-b3bb-e655180664e6', 'volume_size': 1}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1567857927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9998553e-d275-4c39-b3bb-e655180664e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c99aa3ba7e4380b3ed12d065bbd95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:10Z,use_quota=True,user_id='95539f25fbae4f7d8bde55dff15a524b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Creating volume 9998553e-d275-4c39-b3bb-e655180664e6 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:10 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 0 in 0.841s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:10 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6 1073741824
Apr 13 11:20:10 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:10 devstack sudo[85703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:20:10 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:10 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:10 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:10 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 1 in 0.616s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:10 devstack sudo[85714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb
Apr 13 11:20:10 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:10 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6 1073741824" returned: 0 in 0.708s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:11 devstack sudo[85716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6
Apr 13 11:20:11 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:11 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.763s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:11 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-629edfef-41c3-4021-88ff-348ad18255fb" returned: 0 in 0.584s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-quobyte-629edfef-41c3-4021-88ff-348ad18255fb" released by "delete_volume" :: held 2.129s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.quota [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Created reservations ['ad115b49-fb30-4e21-8d8a-671e600ecd43', '0c67196c-7c5b-4e98-8fc1-10c053b9acd7', 'b2945a66-896d-47b0-969b-e0d12bcca590', '0b94841b-664c-4780-b1be-ea4c279297d3'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:11 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6" returned: 0 in 0.647s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:11 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:11 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7fab0a0-807d-4f56-93b5-453926d3603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9998553e-d275-4c39-b3bb-e655180664e6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490eef3f-d3fa-42b4-8b0a-1e1200ed072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Volume volume-9998553e-d275-4c39-b3bb-e655180664e6 (9998553e-d275-4c39-b3bb-e655180664e6): created successfully
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490eef3f-d3fa-42b4-8b0a-1e1200ed072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Flow 'volume_create_manager' (ed786e37-31a2-4f92-b17d-8745e28cfff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:11 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e53115df-6403-403b-9842-f39e98b45ed1 tempest-VolumeQuotasAdminTestJSON-640368160 None] Created volume successfully.
Apr 13 11:20:12 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.492s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.manager [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:12 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Deleted volume successfully.
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-a8316a01-a298-46d6-878c-4d1d565a0c2e req-b3fbf418-ad92-4083-aa0d-c077d7edc432 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-629edfef-41c3-4021-88ff-348ad18255fb-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Flow 'volume_create_manager' (ddbd8b1d-4b75-4d61-87d4-effdfdda7867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6696f9d9-449b-4921-a4ee-53b36b1f817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6696f9d9-449b-4921-a4ee-53b36b1f817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1583424532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa9695c-dc6f-4f93-9377-be2e87c3d2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f02116dc23427fb8be02d6901dc83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:12Z,use_quota=True,user_id='5ccc6419f48448ddb7a45a7df0a8de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3696dea6-63c9-4934-b86a-b68a2c2669ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3696dea6-63c9-4934-b86a-b68a2c2669ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1018f53-ced8-4885-bb04-0e72dd9262ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1018f53-ced8-4885-bb04-0e72dd9262ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa9695c-dc6f-4f93-9377-be2e87c3d2b4', 'volume_name': 'volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bdab10-3aa7-4034-9a6e-bec6066e4c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bdab10-3aa7-4034-9a6e-bec6066e4c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b9c499-5039-49df-87df-c8f2760972bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:12 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4', 'volume_size': 1}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1583424532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa9695c-dc6f-4f93-9377-be2e87c3d2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f02116dc23427fb8be02d6901dc83a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:12Z,use_quota=True,user_id='5ccc6419f48448ddb7a45a7df0a8de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Creating volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:12 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "cinder-9998553e-d275-4c39-b3bb-e655180664e6-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "cinder-9998553e-d275-4c39-b3bb-e655180664e6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:12 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 1073741824
Apr 13 11:20:12 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "cinder-quobyte-9998553e-d275-4c39-b3bb-e655180664e6" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "cinder-quobyte-9998553e-d275-4c39-b3bb-e655180664e6" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce1a465-deaf-4f01-92a0-8e94fcbac832]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:12 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6
Apr 13 11:20:12 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:13 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 1073741824" returned: 0 in 0.567s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:13 devstack sudo[85735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4
Apr 13 11:20:13 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:13 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6" returned: 0 in 0.583s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:13 devstack sudo[85737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6
Apr 13 11:20:13 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:13 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" returned: 0 in 0.554s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b9c499-5039-49df-87df-c8f2760972bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce7e77e-c40f-4715-9304-a2c298177a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:13 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Volume volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 (6fa9695c-dc6f-4f93-9377-be2e87c3d2b4): created successfully
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce7e77e-c40f-4715-9304-a2c298177a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:13 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Flow 'volume_create_manager' (ddbd8b1d-4b75-4d61-87d4-effdfdda7867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9998553e-d275-4c39-b3bb-e655180664e6" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "cinder-quobyte-9998553e-d275-4c39-b3bb-e655180664e6" released by "delete_volume" :: held 1.150s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:13 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d08d47fe-3a22-4f65-8814-20dbdf4c388f tempest-VolumesSnapshotListTestJSON-639256704 None] Created volume successfully.
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Created reservations ['389351a2-8145-4ceb-bb93-553f5e8e44ca', 'd523030a-2253-461e-8f04-bcffe3db68d1', 'b66c46ec-7b68-47b1-b332-fa579ea8abb4', 'ee1b48e5-d8ef-4845-ba86-696116d029b3'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:13 devstack sudo[85782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:13 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:14 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.476s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Deleted volume successfully.
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-700dc205-199b-4ca9-b957-bc52c128a497 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "cinder-9998553e-d275-4c39-b3bb-e655180664e6-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Creating offline snapshot 9b243bee-fc17-4c75-a58a-aaf1ab41b170 of volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938d20b-cddb-464d-ad93-ae94276af81b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:14 devstack sudo[85806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4
Apr 13 11:20:14 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Flow 'volume_create_manager' (246f0aaa-8f68-48b1-9345-4f64a847be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c187f1-0a5d-4c77-a9bb-555dc415b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c187f1-0a5d-4c77-a9bb-555dc415b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-440584131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda63590-5735-4e93-9a61-91c03dcac978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c99aa3ba7e4380b3ed12d065bbd95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:15Z,use_quota=True,user_id='95539f25fbae4f7d8bde55dff15a524b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33d8343-e8e7-44cf-aac4-fdf493ede736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33d8343-e8e7-44cf-aac4-fdf493ede736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53ba887-00a3-49e2-bbdb-b9c76f469a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53ba887-00a3-49e2-bbdb-b9c76f469a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda63590-5735-4e93-9a61-91c03dcac978', 'volume_name': 'volume-fda63590-5735-4e93-9a61-91c03dcac978', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95173529-4f21-48ae-8bff-5fd0b56cd546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95173529-4f21-48ae-8bff-5fd0b56cd546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a8870b-a8fa-4a5f-9fb9-6e09dfe0faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Volume fda63590-5735-4e93-9a61-91c03dcac978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda63590-5735-4e93-9a61-91c03dcac978', 'volume_size': 1}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:15 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" returned: 0 in 0.629s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:15 devstack sudo[85814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 1G
Apr 13 11:20:15 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:16 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 1G" returned: 0 in 0.549s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:16 devstack sudo[85819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:16 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:16 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.495s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:16 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 is being set with open permissions: ugo+rw
Apr 13 11:20:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:16 devstack sudo[85825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:16 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:16 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.448s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:17 devstack sudo[85828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info
Apr 13 11:20:17 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:17 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info" returned: 0 in 0.435s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:17 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info is being set with open permissions: ugo+rw
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:17 devstack sudo[85832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info
Apr 13 11:20:17 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:17 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.info" returned: 0 in 0.406s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.549s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-440584131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda63590-5735-4e93-9a61-91c03dcac978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21c99aa3ba7e4380b3ed12d065bbd95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:15Z,use_quota=True,user_id='95539f25fbae4f7d8bde55dff15a524b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Creating volume fda63590-5735-4e93-9a61-91c03dcac978 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:17 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:17 devstack sudo[85835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978 1073741824
Apr 13 11:20:17 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:17 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b8306ec9-71c4-406c-831e-2218f9a905ac tempest-VolumesSnapshotListTestJSON-639256704 None] Create snapshot completed successfully
Apr 13 11:20:18 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978 1073741824" returned: 0 in 0.517s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:18 devstack sudo[85840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978
Apr 13 11:20:18 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:18 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978" returned: 0 in 0.429s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a8870b-a8fa-4a5f-9fb9-6e09dfe0faf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda63590-5735-4e93-9a61-91c03dcac978', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eb014e-6a6d-452f-90ec-28a3cb4994fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Volume volume-fda63590-5735-4e93-9a61-91c03dcac978 (fda63590-5735-4e93-9a61-91c03dcac978): created successfully
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eb014e-6a6d-452f-90ec-28a3cb4994fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Flow 'volume_create_manager' (246f0aaa-8f68-48b1-9345-4f64a847be84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-75bbf10f-5161-45d9-a85a-9ad838173650 tempest-VolumeQuotasAdminTestJSON-640368160 None] Created volume successfully.
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Creating offline snapshot a8ba158a-bc87-4974-82db-49d1f6249cf2 of volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8891c0aa-c050-4a75-8d1e-9ac792a04d0d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:19 devstack sudo[85844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:19 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:19 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.512s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:19 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 1G
Apr 13 11:20:19 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e9d25d4c-896a-4959-9914-4db0e8704e38 tempest-VolumeQuotasAdminTestJSON-181793687 None] Transfer volume completed successfully.
Apr 13 11:20:20 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 1G" returned: 0 in 0.650s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:20 devstack sudo[85878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:20 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Acquiring lock "cinder-fda63590-5735-4e93-9a61-91c03dcac978-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Lock "cinder-fda63590-5735-4e93-9a61-91c03dcac978-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Acquiring lock "cinder-quobyte-fda63590-5735-4e93-9a61-91c03dcac978" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Lock "cinder-quobyte-fda63590-5735-4e93-9a61-91c03dcac978" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b075d-3250-441b-8dd8-0fa175b6e38c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:20 devstack sudo[85885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978
Apr 13 11:20:20 devstack sudo[85885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:20 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.583s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:20 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 is being set with open permissions: ugo+rw
Apr 13 11:20:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:20 devstack sudo[85887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:20 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:21 devstack sudo[85885]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978" returned: 0 in 0.514s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:21 devstack sudo[85894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978
Apr 13 11:20:21 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:21 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.446s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=172,cinder:INSERT=50,cinder:UPDATE=169,cinder:DELETE=11 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=173,cinder:SELECT=173,cinder:INSERT=58,cinder:DELETE=9 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:21 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d0586a03-acdb-4a1e-bf3f-273a11714b8a tempest-VolumesSnapshotListTestJSON-639256704 None] Create snapshot completed successfully
Apr 13 11:20:21 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fda63590-5735-4e93-9a61-91c03dcac978" returned: 0 in 0.498s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Lock "cinder-quobyte-fda63590-5735-4e93-9a61-91c03dcac978" released by "delete_volume" :: held 1.057s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Created reservations ['0157cd22-9d8a-41d1-af3f-3ef1492de225', '252d12f5-8c4e-4552-99ec-9cf6aff93598', '0c714689-f59e-405f-b34a-14a4a309fce5', '1a64e5a7-69e0-4fc2-81f9-691c1d5dfd78'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:21 devstack sudo[85899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:21 devstack sudo[85899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:22 devstack sudo[85899]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:22 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Deleted volume successfully.
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Creating offline snapshot a19c8add-6dab-42d0-bcd0-2fa13b7eb60c of volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a286c8f-8414-4269-81c8-decc94038438 tempest-VolumeQuotasAdminTestJSON-1462874737 None] Lock "cinder-fda63590-5735-4e93-9a61-91c03dcac978-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa7b8da-353b-4a93-9f1e-6b75be82986b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:22 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:22 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:22 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-219231df-755e-4437-8462-0db2330d7ec0 req-9bce50ab-4b59-471d-8187-95a4a0e5d0f1 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Terminate volume connection completed successfully.
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-219231df-755e-4437-8462-0db2330d7ec0 req-9bce50ab-4b59-471d-8187-95a4a0e5d0f1 tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Deleting attachment 4b42982c-072d-4176-ae18-559664645c54. {{(pid=82099) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 11:20:22 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.528s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:22 devstack sudo[85908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c 1G
Apr 13 11:20:22 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "cinder-908c290d-bca6-42dc-9150-e2417a37ce5a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-908c290d-bca6-42dc-9150-e2417a37ce5a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "cinder-quobyte-908c290d-bca6-42dc-9150-e2417a37ce5a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-quobyte-908c290d-bca6-42dc-9150-e2417a37ce5a" acquired by "delete_volume" :: waited 0.018s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[468c0048-d57a-4834-9c46-1d53478948bf]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:23 devstack sudo[85913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a
Apr 13 11:20:23 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:23 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c 1G" returned: 0 in 0.711s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:23 devstack sudo[85915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c
Apr 13 11:20:23 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:24 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a" returned: 0 in 0.704s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:24 devstack sudo[85923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a
Apr 13 11:20:24 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:24 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" returned: 0 in 0.612s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:24 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c is being set with open permissions: ugo+rw
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:24 devstack sudo[85925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c
Apr 13 11:20:24 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:24 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-908c290d-bca6-42dc-9150-e2417a37ce5a" returned: 0 in 0.493s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-quobyte-908c290d-bca6-42dc-9150-e2417a37ce5a" released by "delete_volume" :: held 1.225s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG cinder.quota [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Created reservations ['82d098f0-c9f1-4ab2-9faa-eaa5b1e175df', '9dc1b3ec-f84c-457a-9581-935f9efa767c', 'b0b9b8f2-715f-49f6-abe5-51361e459131', 'a63209ae-fa35-410a-8db3-fb4315652afd'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:24 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:24 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:24 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" returned: 0 in 0.607s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:24 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-160c9f67-1c55-41f8-8eb4-e256b6cb3435 tempest-VolumesSnapshotListTestJSON-639256704 None] Create snapshot completed successfully
Apr 13 11:20:25 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.596s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:25 devstack cinder-volume[82099]: DEBUG cinder.manager [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:25 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Deleted volume successfully.
Apr 13 11:20:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-219231df-755e-4437-8462-0db2330d7ec0 req-8f2175a3-1890-4584-9028-d9d15d69b5ff tempest-ServerBootFromVolumeStableRescueTest-285191462 None] Lock "cinder-908c290d-bca6-42dc-9150-e2417a37ce5a-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-a19c8add-6dab-42d0-bcd0-2fa13b7eb60c-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-a19c8add-6dab-42d0-bcd0-2fa13b7eb60c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Deleting offline snapshot a19c8add-6dab-42d0-bcd0-2fa13b7eb60c of volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] snapshot_file for this snap is: volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e6678-fc06-47a5-96f8-527023ea1b3e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:26 devstack sudo[85932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c
Apr 13 11:20:26 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:27 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" returned: 0 in 0.737s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f62443b-9e5b-404b-8d92-5198de4d99c3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:27 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:27 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:27 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.618s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:27 devstack sudo[85951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c
Apr 13 11:20:27 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:28 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" returned: 0 in 0.766s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:28 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c
Apr 13 11:20:28 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Flow 'volume_create_manager' (79a795ca-a3aa-41d4-acfe-be8cf003bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573c5122-fb75-44de-a62c-0d5c8e7cc8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573c5122-fb75-44de-a62c-0d5c8e7cc8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-304722910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9e807e-16bd-4529-ac44-e2a08092a12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f86f797ab740a89722cbe6a13c2efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:29Z,use_quota=True,user_id='bbe4c092cf8f49bd8445d1c35a05a18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67db1e1-ccbc-44fd-87b8-28aa18b8c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67db1e1-ccbc-44fd-87b8-28aa18b8c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1de62f-4c6e-4861-a5b1-f330119e432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1de62f-4c6e-4861-a5b1-f330119e432e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9e807e-16bd-4529-ac44-e2a08092a12f', 'volume_name': 'volume-5c9e807e-16bd-4529-ac44-e2a08092a12f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ffa31f-9773-46b1-a98e-caa21cf2c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:28 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ffa31f-9773-46b1-a98e-caa21cf2c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ac34b2-9864-412c-a2ea-f5da431bfec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:29 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Volume 5c9e807e-16bd-4529-ac44-e2a08092a12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9e807e-16bd-4529-ac44-e2a08092a12f', 'volume_size': 1}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-304722910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9e807e-16bd-4529-ac44-e2a08092a12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f86f797ab740a89722cbe6a13c2efc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:29Z,use_quota=True,user_id='bbe4c092cf8f49bd8445d1c35a05a18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Creating volume 5c9e807e-16bd-4529-ac44-e2a08092a12f {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:29 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" returned: 0 in 0.586s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:29 devstack sudo[85985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f 1073741824
Apr 13 11:20:29 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-a19c8add-6dab-42d0-bcd0-2fa13b7eb60c" released by "_delete_snapshot" :: held 2.771s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" released by "delete_snapshot" :: held 2.788s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Created reservations ['ce96161f-1603-43db-91e2-6d8646916c08', '77779be3-15d8-4d1f-8e03-b232b01686fe', 'eb2607f6-4ce6-4f9e-a445-7244964bc717', '54a54622-6459-4648-9432-2feca62d318d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Delete snapshot completed successfully.
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a8d0810d-45b7-4347-9077-de3f089b87f8 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-a19c8add-6dab-42d0-bcd0-2fa13b7eb60c-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-a8ba158a-bc87-4974-82db-49d1f6249cf2-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-a8ba158a-bc87-4974-82db-49d1f6249cf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-a8ba158a-bc87-4974-82db-49d1f6249cf2" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-a8ba158a-bc87-4974-82db-49d1f6249cf2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Deleting offline snapshot a8ba158a-bc87-4974-82db-49d1f6249cf2 of volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] snapshot_file for this snap is: volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84284c5-c39b-4ae2-9eb4-df9743797231]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:29 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:29 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:29 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f 1073741824" returned: 0 in 0.743s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:29 devstack sudo[85994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f
Apr 13 11:20:29 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:30 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.631s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b122c2c-9c55-4179-ba40-c89265ede858]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:30 devstack sudo[86000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:30 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:30 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f" returned: 0 in 0.551s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ac34b2-9864-412c-a2ea-f5da431bfec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9e807e-16bd-4529-ac44-e2a08092a12f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bfd182-348c-411b-882a-5d683764fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Volume volume-5c9e807e-16bd-4529-ac44-e2a08092a12f (5c9e807e-16bd-4529-ac44-e2a08092a12f): created successfully
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bfd182-348c-411b-882a-5d683764fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Flow 'volume_create_manager' (79a795ca-a3aa-41d4-acfe-be8cf003bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3bad3cdd-d51d-4294-8a58-2fb7a548a063 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Created volume successfully.
Apr 13 11:20:30 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.560s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:30 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:30 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:31 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.576s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:31 devstack sudo[86012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2
Apr 13 11:20:31 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:31 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.a8ba158a-bc87-4974-82db-49d1f6249cf2" returned: 0 in 0.462s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-a8ba158a-bc87-4974-82db-49d1f6249cf2" released by "_delete_snapshot" :: held 2.301s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" released by "delete_snapshot" :: held 2.315s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Created reservations ['d07dcbc1-a8cf-4aec-882d-6cb5b97c04d9', 'f4e3196b-8594-4240-b49e-74cc788b08db', 'b7632a0d-285f-42ba-82cc-c4d3878504d7', 'ceafa29f-8d11-4b1e-b05c-a615b44100c6'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Acquiring lock "cinder-5c9e807e-16bd-4529-ac44-e2a08092a12f-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "cinder-5c9e807e-16bd-4529-ac44-e2a08092a12f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:31 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Delete snapshot completed successfully.
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6478acaa-c32b-4f55-8b02-ff3466a82a20 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-a8ba158a-bc87-4974-82db-49d1f6249cf2-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Acquiring lock "cinder-quobyte-5c9e807e-16bd-4529-ac44-e2a08092a12f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "cinder-quobyte-5c9e807e-16bd-4529-ac44-e2a08092a12f" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c66f86e-c091-4bd6-bd64-deb7940c6009]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:32 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f
Apr 13 11:20:32 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:32 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f" returned: 0 in 0.602s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:32 devstack sudo[86020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f
Apr 13 11:20:32 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-9b243bee-fc17-4c75-a58a-aaf1ab41b170-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-9b243bee-fc17-4c75-a58a-aaf1ab41b170-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-9b243bee-fc17-4c75-a58a-aaf1ab41b170" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-9b243bee-fc17-4c75-a58a-aaf1ab41b170" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Deleting offline snapshot 9b243bee-fc17-4c75-a58a-aaf1ab41b170 of volume 6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] snapshot_file for this snap is: volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57659f5-8ab4-4715-8ec4-214889f041cc]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:32 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:32 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:33 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5c9e807e-16bd-4529-ac44-e2a08092a12f" returned: 0 in 0.589s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "cinder-quobyte-5c9e807e-16bd-4529-ac44-e2a08092a12f" released by "delete_volume" :: held 1.224s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Created reservations ['83d80b45-ffd1-4d89-81fc-42a114ac4cf2', 'e512cf47-a03f-422b-a7bb-51404ce6b2df', '50cb1a45-22d2-47df-ba99-434e59c8943d', '7a9de647-c909-4c30-aabe-d675ba3fca6b'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:33 devstack sudo[86028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:33 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:33 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.643s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb201c-bfd6-45ca-a344-47eb18046a12]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:33 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4
Apr 13 11:20:33 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:33 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.543s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Flow 'volume_create_manager' (f61a657d-a728-44d0-a26b-df6a4714e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8173ab94-6e6c-487e-82e8-e74bc8b41921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8173ab94-6e6c-487e-82e8-e74bc8b41921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-253363483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695f38f9-20cc-4eb3-a6b0-a8ee335346e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504540f94e22492085dbe495d9388c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:34Z,use_quota=True,user_id='84b4824613ba45c9a61eeb11268aca3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7614f28-f69d-46ae-8f95-6c308c130177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7614f28-f69d-46ae-8f95-6c308c130177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17543c1e-ab15-4c3b-b1ad-80440e6f4aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17543c1e-ab15-4c3b-b1ad-80440e6f4aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695f38f9-20cc-4eb3-a6b0-a8ee335346e8', 'volume_name': 'volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b208ea2-e6e7-4f51-8cfe-54be458bd6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b208ea2-e6e7-4f51-8cfe-54be458bd6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920e0663-4be7-4955-900e-3a7f0d1a794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:33 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Volume 695f38f9-20cc-4eb3-a6b0-a8ee335346e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8', 'volume_size': 1}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-253363483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695f38f9-20cc-4eb3-a6b0-a8ee335346e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504540f94e22492085dbe495d9388c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:34Z,use_quota=True,user_id='84b4824613ba45c9a61eeb11268aca3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Creating volume 695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:33 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:33 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Deleted volume successfully.
Apr 13 11:20:34 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 1073741824
Apr 13 11:20:34 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcdb2421-3c94-4110-9c05-0037391199c7 tempest-VolumeQuotasNegativeTestJSON-78567617 None] Lock "cinder-5c9e807e-16bd-4529-ac44-e2a08092a12f-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:34 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" returned: 0 in 0.645s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:34 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:34 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:34 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 1073741824" returned: 0 in 0.627s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:34 devstack sudo[86047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8
Apr 13 11:20:34 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:34 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.654s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:34 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170
Apr 13 11:20:34 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:35 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" returned: 0 in 0.495s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920e0663-4be7-4955-900e-3a7f0d1a794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc6c851-719b-4280-b7ea-35f90a663788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:35 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Volume volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 (695f38f9-20cc-4eb3-a6b0-a8ee335346e8): created successfully
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc6c851-719b-4280-b7ea-35f90a663788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Flow 'volume_create_manager' (f61a657d-a728-44d0-a26b-df6a4714e17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e6342358-5903-4447-86f6-66c14a948c90 tempest-SnapshotMetadataTestJSON-793334865 None] Created volume successfully.
Apr 13 11:20:35 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4.9b243bee-fc17-4c75-a58a-aaf1ab41b170" returned: 0 in 0.598s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-9b243bee-fc17-4c75-a58a-aaf1ab41b170" released by "_delete_snapshot" :: held 2.619s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" released by "delete_snapshot" :: held 2.632s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Created reservations ['03a9b200-6425-4e38-9930-2c1ea524c304', 'dd19cbee-84c8-49b4-b21c-6d0e2a63e522', '33485724-6596-4462-b476-ca92ef6cb335', '6b0b636b-f117-4571-9f20-875be75bd1fa'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Delete snapshot completed successfully.
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5d4c3eeb-2472-4514-b2f8-b14a3894b33c tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-9b243bee-fc17-4c75-a58a-aaf1ab41b170-delete_snapshot" released by "delete_snapshot" :: held 2.753s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0251302-7ec0-4f45-b3ea-f483e7b0c94f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:36 devstack sudo[86053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4
Apr 13 11:20:36 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Creating offline snapshot 7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 of volume 695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cfe48e-a012-4fd3-ad9b-4c0c01b46568]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:36 devstack sudo[86056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8
Apr 13 11:20:36 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:36 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" returned: 0 in 0.618s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:36 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4
Apr 13 11:20:36 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:36 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" returned: 0 in 0.611s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:36 devstack sudo[86066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 1G
Apr 13 11:20:36 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:37 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" returned: 0 in 0.569s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-quobyte-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4" released by "delete_volume" :: held 1.245s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Created reservations ['1c094888-b37f-4f1f-b7a1-b7bee909285c', '952e3d7d-6ea4-47cb-b31c-5b86ae76a2ca', 'a22b73d1-be60-432e-94a8-01ce40bcfae7', '848a52ce-fc26-4e40-8b4b-888944cffb95'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:37 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:37 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:37 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 1G" returned: 0 in 0.637s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:37 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637
Apr 13 11:20:37 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:37 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Deleted volume successfully.
Apr 13 11:20:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6a6c0774-080c-4bdc-bd3a-9341e4c72031 tempest-VolumesSnapshotListTestJSON-639256704 None] Lock "cinder-6fa9695c-dc6f-4f93-9377-be2e87c3d2b4-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Flow 'volume_create_manager' (703f8cb9-ecf2-481b-8833-783fbc5f0367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed90336-2b5a-4822-9300-7ca1bd2674ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:38 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed90336-2b5a-4822-9300-7ca1bd2674ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1355175199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4958d6ba-4cb2-4770-bade-3f10ee601cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1134a4da308b422aaa1d3af2ad627d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:38Z,use_quota=True,user_id='bcd8ad04734a477799c1ca8ab5c39467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9b64434-93fe-41a1-a785-fe4b06f8244a),volume_type_id=c9b64434-93fe-41a1-a785-fe4b06f8244a)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c11fac1-dec2-4988-89ac-4db76da3bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c11fac1-dec2-4988-89ac-4db76da3bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53683293-b023-464d-9517-aecae8d0c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53683293-b023-464d-9517-aecae8d0c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4958d6ba-4cb2-4770-bade-3f10ee601cb8', 'volume_name': 'volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dab6dcb-333b-4eea-a4d7-fab2f3119804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dab6dcb-333b-4eea-a4d7-fab2f3119804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0d5e41-007f-4c82-a00d-a33fd642d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:38 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Volume 4958d6ba-4cb2-4770-bade-3f10ee601cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8', 'volume_size': 1}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" returned: 0 in 0.601s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:38 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 is being set with open permissions: ugo+rw
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:38 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637
Apr 13 11:20:38 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:38 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" returned: 0 in 0.498s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:38 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info
Apr 13 11:20:38 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:39 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info" returned: 0 in 0.522s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:39 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info is being set with open permissions: ugo+rw
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:39 devstack sudo[86088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info
Apr 13 11:20:39 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:39 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.info" returned: 0 in 0.492s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.427s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1355175199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4958d6ba-4cb2-4770-bade-3f10ee601cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1134a4da308b422aaa1d3af2ad627d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:38Z,use_quota=True,user_id='bcd8ad04734a477799c1ca8ab5c39467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9b64434-93fe-41a1-a785-fe4b06f8244a),volume_type_id=c9b64434-93fe-41a1-a785-fe4b06f8244a)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Creating volume 4958d6ba-4cb2-4770-bade-3f10ee601cb8 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:39 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:39 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 1073741824
Apr 13 11:20:39 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-87d31c47-6df2-4b78-a8d5-5560f5654383 tempest-SnapshotMetadataTestJSON-793334865 None] Create snapshot completed successfully
Apr 13 11:20:39 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (2260468c-c9f5-4f8f-9844-9fcfcd7ada94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d2c7da-de34-4fc2-a427-d6c30ce46bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d2c7da-de34-4fc2-a427-d6c30ce46bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465561781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a69493-daaa-497f-bf8d-fe05f378fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:40Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4764b76d-f2fd-43d6-8e21-31ee72b460bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4764b76d-f2fd-43d6-8e21-31ee72b460bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf15906-e892-48dc-a2a9-7b895c1b9350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf15906-e892-48dc-a2a9-7b895c1b9350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a69493-daaa-497f-bf8d-fe05f378fb2d', 'volume_name': 'volume-46a69493-daaa-497f-bf8d-fe05f378fb2d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c06ddc-b697-43b4-b05b-9a426107e4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c06ddc-b697-43b4-b05b-9a426107e4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9800d8b3-1eb7-4da0-a1d0-2ad3760ce3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume 46a69493-daaa-497f-bf8d-fe05f378fb2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a69493-daaa-497f-bf8d-fe05f378fb2d', 'volume_size': 1}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:40 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 1073741824" returned: 0 in 0.595s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:40 devstack sudo[86096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8
Apr 13 11:20:40 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:40 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465561781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a69493-daaa-497f-bf8d-fe05f378fb2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:40Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating volume 46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:40 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:40 devstack sudo[86099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d 1073741824
Apr 13 11:20:40 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0d5e41-007f-4c82-a00d-a33fd642d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fbf618-895a-4282-8924-d9d0f4e0bce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Volume volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 (4958d6ba-4cb2-4770-bade-3f10ee601cb8): created successfully
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fbf618-895a-4282-8924-d9d0f4e0bce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Flow 'volume_create_manager' (703f8cb9-ecf2-481b-8833-783fbc5f0367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7059c759-2d65-485b-9b53-ffb32efddbfe tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Created volume successfully.
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "cinder-7f62e9ea-0a1f-4cba-a1f8-ad1273a99637-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-7f62e9ea-0a1f-4cba-a1f8-ad1273a99637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "cinder-quobyte-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-quobyte-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "cinder-quobyte-7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-quobyte-7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Deleting offline snapshot 7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 of volume 695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] snapshot_file for this snap is: volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fc34da-54f0-4cb8-b413-492f611b0521]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:41 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637
Apr 13 11:20:41 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:41 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d 1073741824" returned: 0 in 0.545s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:41 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d
Apr 13 11:20:41 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:41 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:41 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:41 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" returned: 0 in 0.789s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a207a04-71f1-47bf-95f7-03acb0860151]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:41 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:41 devstack sudo[86113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d" returned: 0 in 0.490s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:41 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9800d8b3-1eb7-4da0-a1d0-2ad3760ce3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a69493-daaa-497f-bf8d-fe05f378fb2d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a195d264-3e4b-47f2-8371-315b81c94e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:41 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume volume-46a69493-daaa-497f-bf8d-fe05f378fb2d (46a69493-daaa-497f-bf8d-fe05f378fb2d): created successfully
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a195d264-3e4b-47f2-8371-315b81c94e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (2260468c-c9f5-4f8f-9844-9fcfcd7ada94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:41 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-47294f34-69c0-449a-8148-63bf297c377d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created volume successfully.
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating offline snapshot fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab of volume 46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c587a7bb-f455-4f9f-9d52-d8cc4bac7504]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:42 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.701s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:42 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4fd80207-c73f-4ce9-b7a6-77bf82fd45a4 tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Retype volume completed successfully.
Apr 13 11:20:42 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d
Apr 13 11:20:42 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:42 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" returned: 0 in 0.622s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:42 devstack sudo[86122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637
Apr 13 11:20:42 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:42 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d" returned: 0 in 0.596s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:42 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab 1G
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Acquiring lock "cinder-4958d6ba-4cb2-4770-bade-3f10ee601cb8-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:42 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "cinder-4958d6ba-4cb2-4770-bade-3f10ee601cb8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Acquiring lock "cinder-quobyte-4958d6ba-4cb2-4770-bade-3f10ee601cb8" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:42 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "cinder-quobyte-4958d6ba-4cb2-4770-bade-3f10ee601cb8" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adfa7de-a6e9-4307-ae3b-c5b4a525fed1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:43 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" returned: 0 in 0.705s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:43 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637
Apr 13 11:20:43 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:43 devstack sudo[86133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8
Apr 13 11:20:43 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:43 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab 1G" returned: 0 in 0.678s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a69493-daaa-497f-bf8d-fe05f378fb2d -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:43 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a69493-daaa-497f-bf8d-fe05f378fb2d -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab
Apr 13 11:20:43 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:43 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8" returned: 0 in 0.667s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:43 devstack sudo[86146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8
Apr 13 11:20:43 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:43 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8.7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" returned: 0 in 0.675s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-quobyte-7f62e9ea-0a1f-4cba-a1f8-ad1273a99637" released by "_delete_snapshot" :: held 2.878s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-quobyte-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" released by "delete_snapshot" :: held 2.906s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Created reservations ['341cabac-e0ad-4181-8380-e157dc4c70ab', 'aacddc87-3e1e-4b74-a472-cab380200758', 'b3003f45-8183-4da1-8ccf-cb659d90d565', '5f208f64-6d0d-4a4d-ac37-332086441134'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:43 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Delete snapshot completed successfully.
Apr 13 11:20:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-134a2413-01a0-419b-abfd-5864da8bcfcc tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-7f62e9ea-0a1f-4cba-a1f8-ad1273a99637-delete_snapshot" released by "delete_snapshot" :: held 3.041s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:44 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a69493-daaa-497f-bf8d-fe05f378fb2d -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" returned: 0 in 0.614s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:44 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab is being set with open permissions: ugo+rw
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "cinder-695f38f9-20cc-4eb3-a6b0-a8ee335346e8-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:44 devstack sudo[86152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab
Apr 13 11:20:44 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-695f38f9-20cc-4eb3-a6b0-a8ee335346e8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:44 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4958d6ba-4cb2-4770-bade-3f10ee601cb8" returned: 0 in 0.582s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "cinder-quobyte-4958d6ba-4cb2-4770-bade-3f10ee601cb8" released by "delete_volume" :: held 1.293s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "cinder-quobyte-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:44 devstack cinder-volume[82099]: WARNING cinder.quota [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:20:44 devstack cinder-volume[82099]: WARNING cinder.quota [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-quobyte-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" acquired by "delete_volume" :: waited 0.025s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Created reservations ['6123d0cb-f3a0-4082-a2ff-a07cd7cd597b', 'c9e46174-537d-4743-9359-59e62f662018', '001d5a5e-b354-4f78-82af-888516d2464f', '09103745-fe04-4e8a-8bb9-048919407dcb'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6bae62-882d-43d6-906e-0cb2556a74be]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:44 devstack sudo[86155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:44 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:44 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8
Apr 13 11:20:44 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:44 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" returned: 0 in 0.503s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:44 devstack sudo[86159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info
Apr 13 11:20:44 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:44 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.468s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Deleted volume successfully.
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11d400af-6559-4537-b553-1dc390b20c5c tempest-VolumeRetypeWithoutMigrationTest-1031099685 None] Lock "cinder-4958d6ba-4cb2-4770-bade-3f10ee601cb8-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:44 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" returned: 0 in 0.644s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:45 devstack sudo[86165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8
Apr 13 11:20:45 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:45 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info" returned: 0 in 0.551s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:45 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info is being set with open permissions: ugo+rw
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:45 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info
Apr 13 11:20:45 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:45 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" returned: 0 in 0.509s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-quobyte-695f38f9-20cc-4eb3-a6b0-a8ee335346e8" released by "delete_volume" :: held 1.189s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Created reservations ['9df74dcb-cae8-4566-88bc-43cb4dc0e31c', '1f35baaa-f431-44ec-b54c-58bb08dd15e9', '0307238d-4c8f-45ef-91c6-94ef2dbd0867', '9e8e9c7d-abb0-4b11-839f-765b044cd65c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:45 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:45 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:45 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.info" returned: 0 in 0.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.477s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:45 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b072ddee-92bf-4139-b328-7e2887d075a1 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Create snapshot completed successfully
Apr 13 11:20:46 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.565s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:46 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Deleted volume successfully.
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc369bef-9fbe-4167-81e1-e4229b9c2e0f tempest-SnapshotMetadataTestJSON-793334865 None] Lock "cinder-695f38f9-20cc-4eb3-a6b0-a8ee335346e8-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (ea2b52cb-6ae8-49f4-8fe0-55442d191cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3126f23-5082-4545-b0af-cb7cdb13ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3126f23-5082-4545-b0af-cb7cdb13ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638554714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0475b1f1-db82-42e6-a64f-09fb596f27e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:47Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1371a0-9357-4253-9d23-92ea0c1e0d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1371a0-9357-4253-9d23-92ea0c1e0d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cb9a4a-2869-4c5d-aea3-40152b1ff941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cb9a4a-2869-4c5d-aea3-40152b1ff941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0475b1f1-db82-42e6-a64f-09fb596f27e2', 'volume_name': 'volume-0475b1f1-db82-42e6-a64f-09fb596f27e2', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9427bf59-da30-4584-87b5-809871ec62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9427bf59-da30-4584-87b5-809871ec62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3df115-dc14-45f4-80fe-57bc968155b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:46 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume 0475b1f1-db82-42e6-a64f-09fb596f27e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0475b1f1-db82-42e6-a64f-09fb596f27e2', 'volume_size': 1}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638554714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0475b1f1-db82-42e6-a64f-09fb596f27e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:47Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating volume 0475b1f1-db82-42e6-a64f-09fb596f27e2 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:46 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:46 devstack sudo[86175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 1073741824
Apr 13 11:20:46 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (e4ba074f-4d62-4585-9d8d-c4fe6a69302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8845c82-105b-4d87-83fa-6ed6068d46f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:47 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 1073741824" returned: 0 in 0.803s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8845c82-105b-4d87-83fa-6ed6068d46f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182872852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2281bb12-871d-41a2-b723-fd635bb89eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:48Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a50534-7fef-49ce-ab5a-c516e031b105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a50534-7fef-49ce-ab5a-c516e031b105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c4808b-b343-4835-a484-3d565143f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c4808b-b343-4835-a484-3d565143f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2281bb12-871d-41a2-b723-fd635bb89eb6', 'volume_name': 'volume-2281bb12-871d-41a2-b723-fd635bb89eb6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08263c51-16d8-42ed-aa26-e7e92db56e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08263c51-16d8-42ed-aa26-e7e92db56e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dd65a8-3dd4-4f50-a1fc-b9ebbf3783ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:47 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume 2281bb12-871d-41a2-b723-fd635bb89eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2281bb12-871d-41a2-b723-fd635bb89eb6', 'volume_size': 1}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:47 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2
Apr 13 11:20:47 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (52e9f974-d167-4fd0-8f64-166e868aa031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31d79b1-55fd-4b42-9606-9e7bdb3b7f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31d79b1-55fd-4b42-9606-9e7bdb3b7f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396173414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fa4413-d5ef-495d-a43e-ff287049fe97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:48Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f95e67-4ff6-44ee-8a1b-a74e928ca65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f95e67-4ff6-44ee-8a1b-a74e928ca65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721f5c50-587d-4889-ad32-abe8db9d9928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721f5c50-587d-4889-ad32-abe8db9d9928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fa4413-d5ef-495d-a43e-ff287049fe97', 'volume_name': 'volume-84fa4413-d5ef-495d-a43e-ff287049fe97', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c2f7e1-aaf4-45c4-b6b2-1259e87bf578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c2f7e1-aaf4-45c4-b6b2-1259e87bf578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c7e81d-0cdf-4f26-bd03-95698ee00eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume 84fa4413-d5ef-495d-a43e-ff287049fe97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fa4413-d5ef-495d-a43e-ff287049fe97', 'volume_size': 1}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (b372ef2b-f712-4d2e-9a18-d2739021af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404129b1-813e-4c50-a6e2-0f0c63c3d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404129b1-813e-4c50-a6e2-0f0c63c3d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1281585446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d87a96-4433-4d0d-baf5-4d0bd70e7cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:48Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a69a0d0-2fde-49c4-9c65-295e6cb57a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a69a0d0-2fde-49c4-9c65-295e6cb57a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd76f1-c179-46bb-ae15-d4ad7390a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bd76f1-c179-46bb-ae15-d4ad7390a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d87a96-4433-4d0d-baf5-4d0bd70e7cb9', 'volume_name': 'volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28415167-82fb-4e13-b60f-f2c1747f67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28415167-82fb-4e13-b60f-f2c1747f67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6138e688-f00e-4077-bcc2-d6fb456263b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume 15d87a96-4433-4d0d-baf5-4d0bd70e7cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9', 'volume_size': 1}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (3cfa4308-be08-4fc2-831e-58035bf35d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82249f9-857f-415a-9408-db641e585b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82249f9-857f-415a-9408-db641e585b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048985634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069e8493-cd85-44c4-a1aa-e58017551c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:49Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9b60a8-4d88-4e6c-801e-2b93029c8ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9b60a8-4d88-4e6c-801e-2b93029c8ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b2509a-46c3-42fe-b7bf-a93b0aa457fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b2509a-46c3-42fe-b7bf-a93b0aa457fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069e8493-cd85-44c4-a1aa-e58017551c78', 'volume_name': 'volume-069e8493-cd85-44c4-a1aa-e58017551c78', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d608a3-2271-436f-9252-cfdec7abc020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d608a3-2271-436f-9252-cfdec7abc020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667d40d9-86c5-4572-810d-896c4977a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume 069e8493-cd85-44c4-a1aa-e58017551c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069e8493-cd85-44c4-a1aa-e58017551c78', 'volume_size': 1}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:48 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2" returned: 0 in 0.968s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182872852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2281bb12-871d-41a2-b723-fd635bb89eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:48Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating volume 2281bb12-871d-41a2-b723-fd635bb89eb6 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:48 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3df115-dc14-45f4-80fe-57bc968155b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0475b1f1-db82-42e6-a64f-09fb596f27e2', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674dd169-4521-43d3-8926-1ddca5cfe93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:48 devstack sudo[86184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6 1073741824
Apr 13 11:20:48 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:48 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 (0475b1f1-db82-42e6-a64f-09fb596f27e2): created successfully
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674dd169-4521-43d3-8926-1ddca5cfe93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (ea2b52cb-6ae8-49f4-8fe0-55442d191cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1e2589bd-7756-477f-a49f-efe2c6d60063 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created volume successfully.
Apr 13 11:20:49 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6 1073741824" returned: 0 in 0.614s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:49 devstack sudo[86189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6
Apr 13 11:20:49 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:49 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6" returned: 0 in 0.520s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396173414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fa4413-d5ef-495d-a43e-ff287049fe97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:48Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating volume 84fa4413-d5ef-495d-a43e-ff287049fe97 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:49 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dd65a8-3dd4-4f50-a1fc-b9ebbf3783ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2281bb12-871d-41a2-b723-fd635bb89eb6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080b6cd2-a699-4f3a-962c-3bbaf159c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:49 devstack sudo[86196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97 1073741824
Apr 13 11:20:49 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:49 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume volume-2281bb12-871d-41a2-b723-fd635bb89eb6 (2281bb12-871d-41a2-b723-fd635bb89eb6): created successfully
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080b6cd2-a699-4f3a-962c-3bbaf159c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (e4ba074f-4d62-4585-9d8d-c4fe6a69302c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:49 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4bad3636-050f-4d72-9576-1c410ca3b3b3 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created volume successfully.
Apr 13 11:20:50 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97 1073741824" returned: 0 in 0.746s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:50 devstack sudo[86202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97
Apr 13 11:20:50 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:50 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Flow 'volume_create_manager' (49648cea-aff0-4ca7-baa4-4cf8e3d00e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265a6ca0-9dcb-4e69-9913-c7ac5e24f860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265a6ca0-9dcb-4e69-9913-c7ac5e24f860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1159958637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d38757-dd07-4c93-ad12-00ed11dd748f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77776da2cf744511ab08bfcb5d61695a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:51Z,use_quota=True,user_id='fdce45846a114359b4e8aba6e804ec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecea079a-aa12-4f07-93bb-b7ffbedb936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecea079a-aa12-4f07-93bb-b7ffbedb936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ebcc4-b3c3-425b-80b1-d66a9a16083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ebcc4-b3c3-425b-80b1-d66a9a16083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d38757-dd07-4c93-ad12-00ed11dd748f', 'volume_name': 'volume-a2d38757-dd07-4c93-ad12-00ed11dd748f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d12ec3d-7cac-449a-b6b5-cc53134b8d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d12ec3d-7cac-449a-b6b5-cc53134b8d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f45659-0094-47ea-b1e3-44944da55b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Volume a2d38757-dd07-4c93-ad12-00ed11dd748f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d38757-dd07-4c93-ad12-00ed11dd748f', 'volume_size': 1}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Flow 'volume_create_manager' (a94dcd11-63b4-4093-a0b8-a96bddb633fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006d1a0c-4eb4-40b5-b7dd-90376a99a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006d1a0c-4eb4-40b5-b7dd-90376a99a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401414571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aef77dd-d803-450f-bbae-0efbe999268c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4db3342a2447198cc72edf0f416b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:51Z,use_quota=True,user_id='497c9c8102914300b8434f0ef635492f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f412f3c-cc46-4507-ab19-f4066ef979ba),volume_type_id=0f412f3c-cc46-4507-ab19-f4066ef979ba)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dafaf7-c9c6-4f9b-bc19-8db494e6061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dafaf7-c9c6-4f9b-bc19-8db494e6061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bac7da-c357-4788-b3ab-0a8c0ffb1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67bac7da-c357-4788-b3ab-0a8c0ffb1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aef77dd-d803-450f-bbae-0efbe999268c', 'volume_name': 'volume-2aef77dd-d803-450f-bbae-0efbe999268c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1461f449-dc55-4f23-b6ea-db025190adff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1461f449-dc55-4f23-b6ea-db025190adff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4afcc18-9532-4587-bf9c-dd15e1bf8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Volume 2aef77dd-d803-450f-bbae-0efbe999268c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aef77dd-d803-450f-bbae-0efbe999268c', 'volume_size': 1}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97" returned: 0 in 0.585s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.891s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1281585446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d87a96-4433-4d0d-baf5-4d0bd70e7cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:48Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating volume 15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:51 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c7e81d-0cdf-4f26-bd03-95698ee00eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fa4413-d5ef-495d-a43e-ff287049fe97', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack sudo[86205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 1073741824
Apr 13 11:20:51 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d04be6-f48d-449a-83b1-452edabdde87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:51 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume volume-84fa4413-d5ef-495d-a43e-ff287049fe97 (84fa4413-d5ef-495d-a43e-ff287049fe97): created successfully
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d04be6-f48d-449a-83b1-452edabdde87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (52e9f974-d167-4fd0-8f64-166e868aa031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1c2c4a5d-eca7-4b84-a74b-396f7f4c7e14 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created volume successfully.
Apr 13 11:20:51 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 1073741824" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:51 devstack sudo[86210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9
Apr 13 11:20:51 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:52 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9" returned: 0 in 0.437s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.604s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048985634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069e8493-cd85-44c4-a1aa-e58017551c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0da9ebf7694ce5aa7950b462cbaec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:49Z,use_quota=True,user_id='2d9dd281fc1f4b09b72a8118f55bbabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Creating volume 069e8493-cd85-44c4-a1aa-e58017551c78 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:52 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6138e688-f00e-4077-bcc2-d6fb456263b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48f7fa6-214f-49c3-805d-664824dc6251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:52 devstack sudo[86213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78 1073741824
Apr 13 11:20:52 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:52 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 (15d87a96-4433-4d0d-baf5-4d0bd70e7cb9): created successfully
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48f7fa6-214f-49c3-805d-664824dc6251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (b372ef2b-f712-4d2e-9a18-d2739021af45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:52 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bfd79104-f789-45bd-8fd6-adefe2f6628b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created volume successfully.
Apr 13 11:20:52 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78 1073741824" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:52 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78
Apr 13 11:20:52 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:53 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.143s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1159958637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d38757-dd07-4c93-ad12-00ed11dd748f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77776da2cf744511ab08bfcb5d61695a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:51Z,use_quota=True,user_id='fdce45846a114359b4e8aba6e804ec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Creating volume a2d38757-dd07-4c93-ad12-00ed11dd748f {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:53 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667d40d9-86c5-4572-810d-896c4977a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069e8493-cd85-44c4-a1aa-e58017551c78', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e4619d-9f83-42d1-aafd-a4a834bf3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:53 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Volume volume-069e8493-cd85-44c4-a1aa-e58017551c78 (069e8493-cd85-44c4-a1aa-e58017551c78): created successfully
Apr 13 11:20:53 devstack sudo[86221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f 1073741824
Apr 13 11:20:53 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e4619d-9f83-42d1-aafd-a4a834bf3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Flow 'volume_create_manager' (3cfa4308-be08-4fc2-831e-58035bf35d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:53 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-dab723d4-d7ed-4568-b0a5-c394a5de3086 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created volume successfully.
Apr 13 11:20:53 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f 1073741824" returned: 0 in 0.555s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:53 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f
Apr 13 11:20:53 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-069e8493-cd85-44c4-a1aa-e58017551c78-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-069e8493-cd85-44c4-a1aa-e58017551c78-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-069e8493-cd85-44c4-a1aa-e58017551c78" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-069e8493-cd85-44c4-a1aa-e58017551c78" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa431080-a06c-44c3-9089-095634dd7f2d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:54 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f" returned: 0 in 0.485s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401414571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aef77dd-d803-450f-bbae-0efbe999268c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4db3342a2447198cc72edf0f416b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:51Z,use_quota=True,user_id='497c9c8102914300b8434f0ef635492f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f412f3c-cc46-4507-ab19-f4066ef979ba),volume_type_id=0f412f3c-cc46-4507-ab19-f4066ef979ba)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Creating volume 2aef77dd-d803-450f-bbae-0efbe999268c {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:54 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f45659-0094-47ea-b1e3-44944da55b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d38757-dd07-4c93-ad12-00ed11dd748f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d680be-bf8d-43ed-bf4f-022e3af614a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:54 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Volume volume-a2d38757-dd07-4c93-ad12-00ed11dd748f (a2d38757-dd07-4c93-ad12-00ed11dd748f): created successfully
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d680be-bf8d-43ed-bf4f-022e3af614a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:54 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78
Apr 13 11:20:54 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Flow 'volume_create_manager' (49648cea-aff0-4ca7-baa4-4cf8e3d00e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:54 devstack sudo[86230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c 1073741824
Apr 13 11:20:54 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d4b95064-a2b4-4a1c-b216-3a1dccf7fbb9 tempest-VolumesTransfersTest-501197958 None] Created volume successfully.
Apr 13 11:20:54 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c 1073741824" returned: 0 in 0.607s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:54 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78" returned: 0 in 0.669s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:54 devstack sudo[86239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78
Apr 13 11:20:54 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:54 devstack sudo[86241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c
Apr 13 11:20:54 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:55 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-069e8493-cd85-44c4-a1aa-e58017551c78" returned: 0 in 0.608s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-069e8493-cd85-44c4-a1aa-e58017551c78" released by "delete_volume" :: held 1.303s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['63c2affe-a5a8-4a5c-bfba-63125b3fb081', '58ca90c2-27a7-4060-b660-f26b3e0db113', 'c47233ff-2fac-49e6-9242-88a236329637', 'adfe731d-40d3-4cc7-aa8c-3cfd3020d26d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:55 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c" returned: 0 in 0.653s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4afcc18-9532-4587-bf9c-dd15e1bf8703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aef77dd-d803-450f-bbae-0efbe999268c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758eb74-866f-40f9-94a5-5b33197bcbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:55 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Volume volume-2aef77dd-d803-450f-bbae-0efbe999268c (2aef77dd-d803-450f-bbae-0efbe999268c): created successfully
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758eb74-866f-40f9-94a5-5b33197bcbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Flow 'volume_create_manager' (a94dcd11-63b4-4093-a0b8-a96bddb633fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:55 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-730155f0-f2b1-4cd6-9a01-753957b4824f tempest-VolumeTypesAccessTest-1430526592 None] Created volume successfully.
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:55 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:55 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:55 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c521c32b-8232-4f8c-8d38-816724674409 tempest-VolumesTransfersTest-1909589553 None] Transfer volume completed successfully.
Apr 13 11:20:56 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:56 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleted volume successfully.
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-429d9b63-a72c-40b8-91ec-1062da0167f6 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-069e8493-cd85-44c4-a1aa-e58017551c78-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ea810-4e76-4b59-a67d-5dd8d454135a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:56 devstack sudo[86265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9
Apr 13 11:20:56 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Acquiring lock "cinder-a2d38757-dd07-4c93-ad12-00ed11dd748f-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Acquiring lock "cinder-2aef77dd-d803-450f-bbae-0efbe999268c-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-a2d38757-dd07-4c93-ad12-00ed11dd748f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Lock "cinder-2aef77dd-d803-450f-bbae-0efbe999268c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Acquiring lock "cinder-quobyte-a2d38757-dd07-4c93-ad12-00ed11dd748f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Acquiring lock "cinder-quobyte-2aef77dd-d803-450f-bbae-0efbe999268c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-quobyte-a2d38757-dd07-4c93-ad12-00ed11dd748f" acquired by "delete_volume" :: waited 0.031s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Lock "cinder-quobyte-2aef77dd-d803-450f-bbae-0efbe999268c" acquired by "delete_volume" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd1d638-b1ea-495a-97a1-72b2eb6f2ff6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16068f-ed8c-4ab2-b627-9cf78ca32744]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:56 devstack sudo[86267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f
Apr 13 11:20:56 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:56 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c
Apr 13 11:20:56 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:57 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9" returned: 0 in 0.579s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:57 devstack sudo[86274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9
Apr 13 11:20:57 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:57 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f" returned: 0 in 0.496s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:57 devstack sudo[86282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f
Apr 13 11:20:57 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:57 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:57 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c
Apr 13 11:20:57 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:57 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9" returned: 0 in 0.477s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9" released by "delete_volume" :: held 1.095s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['c4433407-86b7-42ef-9e77-0f18c82e87f0', 'ac90a6e4-0136-428f-b72a-b8ec4e92e7ac', '4c195eb9-b024-41d6-ba4a-2fc097b0aa3c', '906bf171-4574-4e93-81b2-31dbd1f5f666'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:57 devstack sudo[86288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:57 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:57 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2aef77dd-d803-450f-bbae-0efbe999268c" returned: 0 in 0.559s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Lock "cinder-quobyte-2aef77dd-d803-450f-bbae-0efbe999268c" released by "delete_volume" :: held 1.101s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:57 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a2d38757-dd07-4c93-ad12-00ed11dd748f" returned: 0 in 0.609s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-quobyte-a2d38757-dd07-4c93-ad12-00ed11dd748f" released by "delete_volume" :: held 1.132s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:57 devstack cinder-volume[82099]: WARNING cinder.quota [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-203332186 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-203332186, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:20:57 devstack cinder-volume[82099]: WARNING cinder.quota [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-203332186 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-203332186, it is now deprecated. Please use the default quota class for default quota.
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Created reservations ['4c91bc56-5b67-4172-b1f3-48f63ef11f59', 'fef6c2bf-edf9-49aa-82a0-6ea3d4891ddd', '4fca11f0-fdb5-4408-948e-dbdd5a6f8a6b', 'd086c620-6488-4ea6-8a96-b4efa526f8ee'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Created reservations ['ce6cea4a-bd4a-4b0a-b783-47e155d1554f', 'ae8fa59e-d71c-4c12-8f9f-4fd60c0a6169', 'cd628f52-8111-4e49-aadd-88c7d9b7c820', 'd8d62141-d2c9-4b70-8dcb-89af23805c75'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:58 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:58 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:58 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:20:58 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:58 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.472s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleted volume successfully.
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7c5cb1c2-1498-4bc4-9a0c-15801753252d tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-15d87a96-4433-4d0d-baf5-4d0bd70e7cb9-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:58 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.429s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Deleted volume successfully.
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f3c6086-b6f7-4266-ba17-1fc28bc05824 tempest-VolumeTypesAccessTest-1430526592 None] Lock "cinder-2aef77dd-d803-450f-bbae-0efbe999268c-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:58 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.457s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:20:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Deleted volume successfully.
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ae28752f-d363-4afe-aa71-9ffc404b40f4 tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-a2d38757-dd07-4c93-ad12-00ed11dd748f-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-84fa4413-d5ef-495d-a43e-ff287049fe97-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-84fa4413-d5ef-495d-a43e-ff287049fe97-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-84fa4413-d5ef-495d-a43e-ff287049fe97" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-84fa4413-d5ef-495d-a43e-ff287049fe97" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[159fd232-8e59-4587-9d78-0256a408a058]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:20:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:58 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97
Apr 13 11:20:58 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Flow 'volume_create_manager' (ff0445bc-4b6f-4975-bd5f-6118c83cc45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9493ab1-8bd5-40a0-af8f-50ecdafd9367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9493ab1-8bd5-40a0-af8f-50ecdafd9367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1405050467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1485b469-d9ff-444d-95df-54432e571130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77776da2cf744511ab08bfcb5d61695a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:59Z,use_quota=True,user_id='fdce45846a114359b4e8aba6e804ec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac65a5d-d3d4-4416-b8cc-5caffc703b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac65a5d-d3d4-4416-b8cc-5caffc703b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8e5b04-1308-4e00-b14e-2f60a4e69ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8e5b04-1308-4e00-b14e-2f60a4e69ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1485b469-d9ff-444d-95df-54432e571130', 'volume_name': 'volume-1485b469-d9ff-444d-95df-54432e571130', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a980a78-5608-4931-bd79-cb1d69089a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a980a78-5608-4931-bd79-cb1d69089a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978ccba5-95cb-40d8-b63c-2f3b0539efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:20:59 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Volume 1485b469-d9ff-444d-95df-54432e571130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1485b469-d9ff-444d-95df-54432e571130', 'volume_size': 1}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1405050467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1485b469-d9ff-444d-95df-54432e571130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77776da2cf744511ab08bfcb5d61695a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:20:59Z,use_quota=True,user_id='fdce45846a114359b4e8aba6e804ec89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Creating volume 1485b469-d9ff-444d-95df-54432e571130 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:20:59 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:59 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130 1073741824
Apr 13 11:20:59 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:20:59 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97" returned: 0 in 0.787s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:20:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:20:59 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97
Apr 13 11:20:59 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:00 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130 1073741824" returned: 0 in 0.791s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:00 devstack sudo[86330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130
Apr 13 11:21:00 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:00 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-84fa4413-d5ef-495d-a43e-ff287049fe97" returned: 0 in 0.769s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-84fa4413-d5ef-495d-a43e-ff287049fe97" released by "delete_volume" :: held 1.602s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['96e78b2f-472b-4bbe-9bcf-28426ba991a4', 'ec99ca87-1609-45b1-bb92-12a4766f0d94', 'a70af0fa-4dbb-4f4f-bd1d-728cf9b06105', '991e0618-8537-43cf-a7a3-e5503dd7ffd6'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:00 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:00 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-2281bb12-871d-41a2-b723-fd635bb89eb6-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-2281bb12-871d-41a2-b723-fd635bb89eb6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:01 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-2281bb12-871d-41a2-b723-fd635bb89eb6" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130" returned: 0 in 0.920s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978ccba5-95cb-40d8-b63c-2f3b0539efbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1485b469-d9ff-444d-95df-54432e571130', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55568640-b82d-4bd4-b68d-88a0df4214a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-2281bb12-871d-41a2-b723-fd635bb89eb6" acquired by "delete_volume" :: waited 0.068s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:01 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Volume volume-1485b469-d9ff-444d-95df-54432e571130 (1485b469-d9ff-444d-95df-54432e571130): created successfully
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55568640-b82d-4bd4-b68d-88a0df4214a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Flow 'volume_create_manager' (ff0445bc-4b6f-4975-bd5f-6118c83cc45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043f3a8-d1ec-4a3b-9f61-15fff89c2714]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:01 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-75547d80-690f-4958-aec4-d072819696b2 tempest-VolumesTransfersTest-501197958 None] Created volume successfully.
Apr 13 11:21:01 devstack sudo[86350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6
Apr 13 11:21:01 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:01 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.849s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:01 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleted volume successfully.
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b8def9a9-6e36-4014-9677-10d67e3ff491 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-84fa4413-d5ef-495d-a43e-ff287049fe97-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Acquiring lock "cinder-1485b469-d9ff-444d-95df-54432e571130-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-1485b469-d9ff-444d-95df-54432e571130-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Acquiring lock "cinder-quobyte-1485b469-d9ff-444d-95df-54432e571130" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-quobyte-1485b469-d9ff-444d-95df-54432e571130" acquired by "delete_volume" :: waited 0.024s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49c26d-ce7f-476e-83df-41499fbac329]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:02 devstack sudo[86355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130
Apr 13 11:21:02 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:02 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6" returned: 0 in 0.983s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:02 devstack sudo[86360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6
Apr 13 11:21:02 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:02 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130" returned: 0 in 0.678s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:02 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130
Apr 13 11:21:02 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:02 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2281bb12-871d-41a2-b723-fd635bb89eb6" returned: 0 in 0.599s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-2281bb12-871d-41a2-b723-fd635bb89eb6" released by "delete_volume" :: held 1.645s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['544faf92-8b0e-4423-b89c-2094726eb1d6', '0415f8cb-52e1-4041-bbd8-a783e8e18a46', '5fe4daa1-20ff-4f57-a788-80c6592cac1d', '61cf8128-e760-4509-bc9f-5a7818af98ba'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:02 devstack sudo[86368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:02 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-0475b1f1-db82-42e6-a64f-09fb596f27e2-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-0475b1f1-db82-42e6-a64f-09fb596f27e2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-0475b1f1-db82-42e6-a64f-09fb596f27e2" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-0475b1f1-db82-42e6-a64f-09fb596f27e2" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943abf3-383a-4db8-a723-60045f0edf56]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:03 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1485b469-d9ff-444d-95df-54432e571130" returned: 0 in 0.765s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-quobyte-1485b469-d9ff-444d-95df-54432e571130" released by "delete_volume" :: held 1.494s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Created reservations ['30b78a8e-c6ca-4685-83b7-5a7fe4f3ef75', 'f2b3bdb3-7939-4224-bbe6-c963c7ec2c46', '0ccd8c1a-3a91-4139-b96c-d4880f1f2d45', '5e20f671-467d-4b71-aa37-f86d1adc1227'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:03 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.665s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:03 devstack sudo[86372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2
Apr 13 11:21:03 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:03 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleted volume successfully.
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1cf2cbe2-f4cb-4618-9c2c-8b733dc3ed5a tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-2281bb12-871d-41a2-b723-fd635bb89eb6-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:03 devstack sudo[86374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:03 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:04 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2" returned: 0 in 0.998s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:04 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2
Apr 13 11:21:04 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:04 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.843s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:04 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Deleted volume successfully.
Apr 13 11:21:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-570c3846-634e-4c0f-b3a1-b0f0e3836e4b tempest-VolumesTransfersTest-1698128616 None] Lock "cinder-1485b469-d9ff-444d-95df-54432e571130-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:05 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0475b1f1-db82-42e6-a64f-09fb596f27e2" returned: 0 in 0.586s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-0475b1f1-db82-42e6-a64f-09fb596f27e2" released by "delete_volume" :: held 1.637s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['b0aa8e61-72dc-4173-9ab1-5f86be32dbcf', 'd8228881-1782-4a0d-a8f5-794675fb6c61', 'add7bf56-06d7-477f-9fd2-35a661467f92', 'a7096d0b-b7a0-4eb3-9c51-47e891cc776f'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:05 devstack sudo[86388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:05 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-46a69493-daaa-497f-bf8d-fe05f378fb2d" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:05 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.585s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleted volume successfully.
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-46a69493-daaa-497f-bf8d-fe05f378fb2d" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-32ff5a1a-b007-4a51-9435-64d49a697592 tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-0475b1f1-db82-42e6-a64f-09fb596f27e2-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleting offline snapshot fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab of volume 46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] snapshot_file for this snap is: volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e76ffc-ac5c-4fa7-87d7-0756743d8fb3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:05 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab
Apr 13 11:21:05 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:06 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" returned: 0 in 0.700s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46a69493-daaa-497f-bf8d-fe05f378fb2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:21:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd36543-b988-4add-987c-9bd4b32560dc]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:06 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d
Apr 13 11:21:06 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:07 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d" returned: 0 in 0.733s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:07 devstack sudo[86407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab
Apr 13 11:21:07 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:07 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" returned: 0 in 0.678s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:07 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab
Apr 13 11:21:07 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:08 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d.fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" returned: 0 in 0.596s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab" released by "_delete_snapshot" :: held 2.790s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-46a69493-daaa-497f-bf8d-fe05f378fb2d" released by "delete_snapshot" :: held 2.808s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['df252071-2c75-417f-a1b8-c19128c33daa', 'c700b65b-ca89-4d14-9156-4b2726ee9b90', 'cae15192-0fa3-4f4c-98c1-377cea9097b0', '0425bdf4-23ba-48dc-97c7-131d17950314'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Delete snapshot completed successfully.
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f164fc58-0669-4277-9d6d-088ed11ec0dc tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-fcbdabe5-8d08-4f0c-bef3-ed28a88cb3ab-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-46a69493-daaa-497f-bf8d-fe05f378fb2d-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-46a69493-daaa-497f-bf8d-fe05f378fb2d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "cinder-quobyte-46a69493-daaa-497f-bf8d-fe05f378fb2d" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-46a69493-daaa-497f-bf8d-fe05f378fb2d" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b46216d-25d3-42ad-a5db-841c78c10f30]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:09 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d
Apr 13 11:21:09 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:10 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d" returned: 0 in 0.992s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:10 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d
Apr 13 11:21:10 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:10 devstack sudo[86425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:10 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Flow 'volume_create_manager' (be0430aa-5401-40e3-b2d2-89464a716766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2bd4cb-1429-463c-9150-dfe3991f6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:10 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2bd4cb-1429-463c-9150-dfe3991f6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-183972424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9d265b-4f53-4c40-a0bd-dc7d4b7af225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8ac72f4bb46e48bb94b2f4e5af74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:11Z,use_quota=True,user_id='7675d8857f8f45c39681b0a887483c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afb7943-4afc-4d3f-892c-5c19d56a5cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afb7943-4afc-4d3f-892c-5c19d56a5cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e800f61e-0e1a-479a-9901-1591217e8246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e800f61e-0e1a-479a-9901-1591217e8246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9d265b-4f53-4c40-a0bd-dc7d4b7af225', 'volume_name': 'volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506d4abf-251a-418c-be35-e41c8587af6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506d4abf-251a-418c-be35-e41c8587af6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8544f3-557c-453b-91fb-32f2f629ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Volume df9d265b-4f53-4c40-a0bd-dc7d4b7af225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225', 'volume_size': 1}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-183972424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9d265b-4f53-4c40-a0bd-dc7d4b7af225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8ac72f4bb46e48bb94b2f4e5af74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:11Z,use_quota=True,user_id='7675d8857f8f45c39681b0a887483c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Creating volume df9d265b-4f53-4c40-a0bd-dc7d4b7af225 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:11 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-46a69493-daaa-497f-bf8d-fe05f378fb2d" returned: 0 in 1.078s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:11 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 1073741824
Apr 13 11:21:11 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-quobyte-46a69493-daaa-497f-bf8d-fe05f378fb2d" released by "delete_volume" :: held 2.158s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Flow 'volume_create_manager' (f6fef7a5-5333-4463-aeee-0b2b922b5d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81216555-05ba-4b66-8222-a02d3057e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Created reservations ['09e22b10-32e7-4a0e-a618-e4c54443a0cc', '29514a58-e550-4f71-a435-105bf2dddaed', '4a0ec175-e5b8-471a-92e9-6366ed9cb128', '692f2b83-cdad-4677-ad39-7992735cfabf'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81216555-05ba-4b66-8222-a02d3057e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1052592671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd03eba-fc54-4f06-8a6b-298bf64feb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb122b083c1642eb931c1ab9692f6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:11Z,use_quota=True,user_id='ac49815dfcfb4cdc9711c7c1e4f06c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d6a5b0-e7b2-4add-bd10-6f4f39d2b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d6a5b0-e7b2-4add-bd10-6f4f39d2b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70194ad5-bf40-48ed-b4f6-2f4160dc2689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70194ad5-bf40-48ed-b4f6-2f4160dc2689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd03eba-fc54-4f06-8a6b-298bf64feb51', 'volume_name': 'volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1642c3a-2b7b-44e2-8fd4-48977170808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1642c3a-2b7b-44e2-8fd4-48977170808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df99847-3dc4-447b-bd4e-654bcaeae815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Volume dcd03eba-fc54-4f06-8a6b-298bf64feb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51', 'volume_size': 1}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:11 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:11 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:11 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.829s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:11 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 1073741824" returned: 0 in 0.762s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:11 devstack sudo[86451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225
Apr 13 11:21:11 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:11 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:11 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Deleted volume successfully.
Apr 13 11:21:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f68b13cb-31a9-40f7-bfd8-57b17f5b8c1b tempest-CreateVolumesFromSnapshotTest-2032707910 None] Lock "cinder-46a69493-daaa-497f-bf8d-fe05f378fb2d-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:12 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1052592671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd03eba-fc54-4f06-8a6b-298bf64feb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb122b083c1642eb931c1ab9692f6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:11Z,use_quota=True,user_id='ac49815dfcfb4cdc9711c7c1e4f06c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Creating volume dcd03eba-fc54-4f06-8a6b-298bf64feb51 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:12 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8544f3-557c-453b-91fb-32f2f629ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:12 devstack sudo[86454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 1073741824
Apr 13 11:21:12 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2747bc06-daea-40ac-b38b-7d45841b26a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:12 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Volume volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 (df9d265b-4f53-4c40-a0bd-dc7d4b7af225): created successfully
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2747bc06-daea-40ac-b38b-7d45841b26a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Flow 'volume_create_manager' (be0430aa-5401-40e3-b2d2-89464a716766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:12 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f0992030-6675-484b-ab2d-d852f9c183c3 tempest-VolumesListAdminTestJSON-461073897 None] Created volume successfully.
Apr 13 11:21:12 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 1073741824" returned: 0 in 0.604s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:13 devstack sudo[86459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51
Apr 13 11:21:13 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Flow 'volume_create_manager' (3386d054-b566-45eb-b229-2690a0b7c800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38755943-47ae-4664-a8f9-ae1a92c0d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38755943-47ae-4664-a8f9-ae1a92c0d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-440819001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6d6cb0-6eba-4c73-bf50-b3876ca530e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8ac72f4bb46e48bb94b2f4e5af74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:13Z,use_quota=True,user_id='7675d8857f8f45c39681b0a887483c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487de7d9-ed88-4566-9928-2321ffb43359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487de7d9-ed88-4566-9928-2321ffb43359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6695b2-5956-424b-96aa-f2e2cae52957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6695b2-5956-424b-96aa-f2e2cae52957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6d6cb0-6eba-4c73-bf50-b3876ca530e3', 'volume_name': 'volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc4f2e-fdff-4955-abfe-92dcc7d04047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc4f2e-fdff-4955-abfe-92dcc7d04047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7980919-a968-4762-95f7-e326432d8cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:13 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Volume 3e6d6cb0-6eba-4c73-bf50-b3876ca530e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3', 'volume_size': 1}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:13 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51" returned: 0 in 0.737s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-440819001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6d6cb0-6eba-4c73-bf50-b3876ca530e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8ac72f4bb46e48bb94b2f4e5af74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:13Z,use_quota=True,user_id='7675d8857f8f45c39681b0a887483c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Creating volume 3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:13 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df99847-3dc4-447b-bd4e-654bcaeae815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81b0809-e4b1-4aad-afe9-e67dbf71d842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:13 devstack sudo[86466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 1073741824
Apr 13 11:21:13 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:13 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Volume volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 (dcd03eba-fc54-4f06-8a6b-298bf64feb51): created successfully
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81b0809-e4b1-4aad-afe9-e67dbf71d842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Flow 'volume_create_manager' (f6fef7a5-5333-4463-aeee-0b2b922b5d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:13 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ab16c75c-1e44-49f2-bef8-4f977d44174c tempest-VolumesTransfersV355Test-2064743318 None] Created volume successfully.
Apr 13 11:21:14 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 1073741824" returned: 0 in 0.853s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:14 devstack sudo[86504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3
Apr 13 11:21:14 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-499b7f85-88c6-409f-a72d-bba4e335c703 tempest-VolumesTransfersV355Test-2136029062 None] Transfer volume completed successfully.
Apr 13 11:21:15 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3" returned: 0 in 0.522s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7980919-a968-4762-95f7-e326432d8cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876cbc9c-88b8-4832-87e1-5080cf3f1273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Volume volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 (3e6d6cb0-6eba-4c73-bf50-b3876ca530e3): created successfully
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876cbc9c-88b8-4832-87e1-5080cf3f1273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Flow 'volume_create_manager' (3386d054-b566-45eb-b229-2690a0b7c800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:15 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8cf72454-a1b3-4e91-8a35-e0d8c1732179 tempest-VolumesListAdminTestJSON-461073897 None] Created volume successfully.
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Flow 'volume_create_manager' (3083c823-593d-4638-abc6-535eb4fa5ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df9dacf-da49-4517-bf60-789886d608fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df9dacf-da49-4517-bf60-789886d608fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1811582967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7900acaf-846a-4eca-9cdd-4867e2ae829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8ac72f4bb46e48bb94b2f4e5af74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:16Z,use_quota=True,user_id='7675d8857f8f45c39681b0a887483c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3daa9b-7a22-4c89-ba13-8103e6b15921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3daa9b-7a22-4c89-ba13-8103e6b15921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754098e-9c76-43c3-bf1b-bc727293b09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b754098e-9c76-43c3-bf1b-bc727293b09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7900acaf-846a-4eca-9cdd-4867e2ae829b', 'volume_name': 'volume-7900acaf-846a-4eca-9cdd-4867e2ae829b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7533748-1715-4b6b-add9-31f19f168aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7533748-1715-4b6b-add9-31f19f168aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31ac612-6795-4067-ba4f-279d546bfe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Volume 7900acaf-846a-4eca-9cdd-4867e2ae829b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7900acaf-846a-4eca-9cdd-4867e2ae829b', 'volume_size': 1}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1811582967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7900acaf-846a-4eca-9cdd-4867e2ae829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf8ac72f4bb46e48bb94b2f4e5af74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:16Z,use_quota=True,user_id='7675d8857f8f45c39681b0a887483c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Creating volume 7900acaf-846a-4eca-9cdd-4867e2ae829b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:15 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Acquiring lock "cinder-dcd03eba-fc54-4f06-8a6b-298bf64feb51-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:15 devstack sudo[86507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b 1073741824
Apr 13 11:21:15 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-dcd03eba-fc54-4f06-8a6b-298bf64feb51-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Acquiring lock "cinder-quobyte-dcd03eba-fc54-4f06-8a6b-298bf64feb51" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-quobyte-dcd03eba-fc54-4f06-8a6b-298bf64feb51" acquired by "delete_volume" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:16 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca7c8b3-b39e-40f1-85ef-a9e69ace58fc]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:16 devstack sudo[86531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51
Apr 13 11:21:16 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:17 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51" returned: 0 in 0.907s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:17 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51
Apr 13 11:21:17 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:17 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b 1073741824" returned: 0 in 1.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:17 devstack sudo[86548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b
Apr 13 11:21:17 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:17 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-dcd03eba-fc54-4f06-8a6b-298bf64feb51" returned: 0 in 0.835s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-quobyte-dcd03eba-fc54-4f06-8a6b-298bf64feb51" released by "delete_volume" :: held 1.836s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Created reservations ['22b9ba97-d504-4204-b173-65e9e47e3471', 'e38ed89d-06b0-4a6a-8855-0529eb6b8c60', '0a172fc2-1a5b-4ddc-944d-4884293ccf89', '1a011229-9ecf-437c-b95b-c8535682106c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:18 devstack sudo[86551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:18 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:18 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b" returned: 0 in 1.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] <== create_volume: return (2935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.937s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Flow 'volume_create_manager' (12ed6140-673f-4e6b-844b-276ed316cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dd0595-0a82-496b-8504-463a270ca8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31ac612-6795-4067-ba4f-279d546bfe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7900acaf-846a-4eca-9cdd-4867e2ae829b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47db83cc-94f5-44f0-83cd-84a58ffd3f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dd0595-0a82-496b-8504-463a270ca8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1472832879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a9894e-05a0-4416-b23e-a3b159466e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb122b083c1642eb931c1ab9692f6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:19Z,use_quota=True,user_id='ac49815dfcfb4cdc9711c7c1e4f06c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b1b70c-4065-486a-b381-b31738aba64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b1b70c-4065-486a-b381-b31738aba64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebedc9eb-5eb8-4de3-98d5-5372777419f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebedc9eb-5eb8-4de3-98d5-5372777419f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a9894e-05a0-4416-b23e-a3b159466e7b', 'volume_name': 'volume-58a9894e-05a0-4416-b23e-a3b159466e7b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0509f37e-40c6-4f75-99e1-ae23bf698f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0509f37e-40c6-4f75-99e1-ae23bf698f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dad6ea7-cc4c-45bc-94de-be386d4df16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Volume 58a9894e-05a0-4416-b23e-a3b159466e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a9894e-05a0-4416-b23e-a3b159466e7b', 'volume_size': 1}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1472832879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a9894e-05a0-4416-b23e-a3b159466e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb122b083c1642eb931c1ab9692f6dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:19Z,use_quota=True,user_id='ac49815dfcfb4cdc9711c7c1e4f06c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Creating volume 58a9894e-05a0-4416-b23e-a3b159466e7b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:18 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Volume volume-7900acaf-846a-4eca-9cdd-4867e2ae829b (7900acaf-846a-4eca-9cdd-4867e2ae829b): created successfully
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47db83cc-94f5-44f0-83cd-84a58ffd3f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Flow 'volume_create_manager' (3083c823-593d-4638-abc6-535eb4fa5ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-486e8c2b-b4c1-4ee0-89d9-ea0db3f57a76 tempest-VolumesListAdminTestJSON-461073897 None] Created volume successfully.
Apr 13 11:21:19 devstack sudo[86555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b 1073741824
Apr 13 11:21:19 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:19 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.075s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:19 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Deleted volume successfully.
Apr 13 11:21:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-73552eef-3d4f-4399-9f8e-d310ca2f171f tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-dcd03eba-fc54-4f06-8a6b-298bf64feb51-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Flow 'volume_create_manager' (e96fbcbb-cd02-4bde-904a-5c45f9f443db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a27c629-91ab-4743-81c3-1d94def7dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a27c629-91ab-4743-81c3-1d94def7dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a411535-fa54-4b2b-85c6-d57eebba4a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f30603014b44b098b153e3d02a9a771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:20Z,use_quota=True,user_id='824289d44b43493cb9d5f9c2b465c873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5100aa6-d3eb-4b75-ab5d-46c873a66f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5100aa6-d3eb-4b75-ab5d-46c873a66f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e0570d-34ed-43a7-ae8b-87d7fe875f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e0570d-34ed-43a7-ae8b-87d7fe875f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a411535-fa54-4b2b-85c6-d57eebba4a5d', 'volume_name': 'volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e69e60-8376-419c-babd-78ccbe422fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e69e60-8376-419c-babd-78ccbe422fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f9350e-3338-4442-bc04-e46e6e198b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:20 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Volume 7a411535-fa54-4b2b-85c6-d57eebba4a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d', 'volume_size': 1}
Apr 13 11:21:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:20 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b 1073741824" returned: 0 in 2.037s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:21 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b
Apr 13 11:21:21 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:22 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b" returned: 0 in 1.085s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] <== create_volume: return (3161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.163s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a411535-fa54-4b2b-85c6-d57eebba4a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f30603014b44b098b153e3d02a9a771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:20Z,use_quota=True,user_id='824289d44b43493cb9d5f9c2b465c873',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Creating volume 7a411535-fa54-4b2b-85c6-d57eebba4a5d {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:22 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=158,cinder:UPDATE=194,cinder:DELETE=15,cinder:INSERT=63 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dad6ea7-cc4c-45bc-94de-be386d4df16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a9894e-05a0-4416-b23e-a3b159466e7b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937c4f5e-331c-4929-a572-2a6156c568f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=159,cinder:INSERT=40,cinder:UPDATE=236,cinder:DELETE=21 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:21:22 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Volume volume-58a9894e-05a0-4416-b23e-a3b159466e7b (58a9894e-05a0-4416-b23e-a3b159466e7b): created successfully
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937c4f5e-331c-4929-a572-2a6156c568f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Flow 'volume_create_manager' (12ed6140-673f-4e6b-844b-276ed316cc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:22 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d 1073741824
Apr 13 11:21:22 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:22 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-99dfc0b7-6b1b-4286-8b15-92bb06cd43cf tempest-VolumesTransfersV355Test-2064743318 None] Created volume successfully.
Apr 13 11:21:22 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d 1073741824" returned: 0 in 0.819s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:23 devstack sudo[86619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d
Apr 13 11:21:23 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Acquiring lock "cinder-58a9894e-05a0-4416-b23e-a3b159466e7b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-58a9894e-05a0-4416-b23e-a3b159466e7b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Acquiring lock "cinder-quobyte-58a9894e-05a0-4416-b23e-a3b159466e7b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-quobyte-58a9894e-05a0-4416-b23e-a3b159466e7b" acquired by "delete_volume" :: waited 0.025s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[842db413-c780-4ec6-9fb1-fa196586941a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:23 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d" returned: 0 in 0.820s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f9350e-3338-4442-bc04-e46e6e198b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:23 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b
Apr 13 11:21:23 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf7a247-a206-4ffa-9171-48d2cdbae918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:23 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Volume volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d (7a411535-fa54-4b2b-85c6-d57eebba4a5d): created successfully
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf7a247-a206-4ffa-9171-48d2cdbae918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Flow 'volume_create_manager' (e96fbcbb-cd02-4bde-904a-5c45f9f443db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a1d3cc0e-eae0-41e9-9e4d-e1465e70c35e tempest-VolumesListAdminTestJSON-73380512 None] Created volume successfully.
Apr 13 11:21:24 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b" returned: 0 in 0.697s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:24 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b
Apr 13 11:21:24 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Acquiring lock "cinder-7a411535-fa54-4b2b-85c6-d57eebba4a5d-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Lock "cinder-7a411535-fa54-4b2b-85c6-d57eebba4a5d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Acquiring lock "cinder-quobyte-7a411535-fa54-4b2b-85c6-d57eebba4a5d" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Lock "cinder-quobyte-7a411535-fa54-4b2b-85c6-d57eebba4a5d" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a1e48-9680-42f0-94e1-b6eddaf37c3f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "cinder-7900acaf-846a-4eca-9cdd-4867e2ae829b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-7900acaf-846a-4eca-9cdd-4867e2ae829b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "cinder-quobyte-7900acaf-846a-4eca-9cdd-4867e2ae829b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-quobyte-7900acaf-846a-4eca-9cdd-4867e2ae829b" acquired by "delete_volume" :: waited 0.024s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1e051-6954-4410-b6d4-5d0ee2286fa8]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:24 devstack sudo[86630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d
Apr 13 11:21:24 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:25 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b
Apr 13 11:21:25 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:25 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a9894e-05a0-4416-b23e-a3b159466e7b" returned: 0 in 0.793s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-quobyte-58a9894e-05a0-4416-b23e-a3b159466e7b" released by "delete_volume" :: held 1.538s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Created reservations ['023058a9-3d3e-4388-908a-fab712f6e80a', '0ace2f67-0e15-4979-ac17-9b7af6d647a2', '4858ad09-3fc6-4dbb-b0b2-5e433c4401a3', '6b5d4e48-5b47-4ba1-82a1-1c644b32c0a5'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:25 devstack sudo[86635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:25 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:25 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b" returned: 0 in 0.725s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:25 devstack sudo[86643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b
Apr 13 11:21:25 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:25 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d" returned: 0 in 1.080s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:25 devstack sudo[86645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d
Apr 13 11:21:25 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:26 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7900acaf-846a-4eca-9cdd-4867e2ae829b" returned: 0 in 0.695s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-quobyte-7900acaf-846a-4eca-9cdd-4867e2ae829b" released by "delete_volume" :: held 1.476s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Created reservations ['1fcf7568-d677-41b8-a418-94cc2f138827', 'd33cff8e-cfa2-45f0-bc5b-ac36275209b1', '94fdc9e0-f835-4bef-80db-c627d29c0e61', '56ea8220-2942-47f9-92a0-4a604e2f80c1'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:26 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.172s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:26 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Deleted volume successfully.
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a3933e03-b5c0-4537-91ae-b5afce4f6eba tempest-VolumesTransfersV355Test-716865026 None] Lock "cinder-58a9894e-05a0-4416-b23e-a3b159466e7b-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:26 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:26 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:26 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7a411535-fa54-4b2b-85c6-d57eebba4a5d" returned: 0 in 1.113s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Lock "cinder-quobyte-7a411535-fa54-4b2b-85c6-d57eebba4a5d" released by "delete_volume" :: held 2.248s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:26 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Created reservations ['97ab7d82-6cf9-4e5c-9233-5f1aa7e2019c', 'dc36162c-85f9-469a-8cf1-9a45dfce2a3a', 'b01ececa-03a7-4e80-a9eb-76450ee91ffc', 'f5aa8b21-a046-4730-814e-101d0626a99d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:27 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:27 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "cinder-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:27 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.755s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Deleted volume successfully.
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c31a1fce-442e-401c-9d24-6dcaf37f8751 tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-7900acaf-846a-4eca-9cdd-4867e2ae829b-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "cinder-quobyte-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-quobyte-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3544a-bccd-4386-b1a8-5d34eea5bead]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:27 devstack sudo[86656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3
Apr 13 11:21:27 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:27 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.916s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Deleted volume successfully.
Apr 13 11:21:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-78279e13-d195-4411-b84e-a34ac6fac4c7 tempest-VolumesListAdminTestJSON-73380512 None] Lock "cinder-7a411535-fa54-4b2b-85c6-d57eebba4a5d-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:28 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3" returned: 0 in 0.904s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:28 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3
Apr 13 11:21:28 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:29 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3" returned: 0 in 0.802s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Flow 'volume_create_manager' (91e24adf-d3da-4c92-82f3-1ebad9fc3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdc1d83-aba3-4b1e-8c41-dfaba11387c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-quobyte-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3" released by "delete_volume" :: held 1.811s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdc1d83-aba3-4b1e-8c41-dfaba11387c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-913943410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3fb24b-72a6-4422-87a6-020fe781d5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbe42c24a8484a91029dd45ce55759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:29Z,use_quota=True,user_id='9ab8403da1f04b90acb363a271622b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed291e85-1beb-484b-80b1-31831c16b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed291e85-1beb-484b-80b1-31831c16b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96d49ca-e2a0-4127-9b3a-99b68dcee7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96d49ca-e2a0-4127-9b3a-99b68dcee7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3fb24b-72a6-4422-87a6-020fe781d5c7', 'volume_name': 'volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243fc032-8365-4833-b5a3-82af13d89dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243fc032-8365-4833-b5a3-82af13d89dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05905412-6696-4754-89e9-0c3b5a90e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:29 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Volume ba3fb24b-72a6-4422-87a6-020fe781d5c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7', 'volume_size': 1}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-913943410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3fb24b-72a6-4422-87a6-020fe781d5c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbe42c24a8484a91029dd45ce55759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:29Z,use_quota=True,user_id='9ab8403da1f04b90acb363a271622b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Creating volume ba3fb24b-72a6-4422-87a6-020fe781d5c7 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:29 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:29 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 1073741824
Apr 13 11:21:29 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Created reservations ['b056d79b-08f1-40ce-b93c-1def4cb9602d', '98015689-d304-4722-bd40-a6de8b20f336', '517350a8-1159-4d9c-897a-c5d6e95d8223', '8d683c92-e905-463a-82b6-ee71ec6e72a7'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:29 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:29 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:30 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 1073741824" returned: 0 in 1.108s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:30 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7
Apr 13 11:21:30 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:30 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.999s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Deleted volume successfully.
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9be45218-3fbd-4caf-af5c-939579d35f6c tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-3e6d6cb0-6eba-4c73-bf50-b3876ca530e3-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "cinder-df9d265b-4f53-4c40-a0bd-dc7d4b7af225-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-df9d265b-4f53-4c40-a0bd-dc7d4b7af225-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "cinder-quobyte-df9d265b-4f53-4c40-a0bd-dc7d4b7af225" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-quobyte-df9d265b-4f53-4c40-a0bd-dc7d4b7af225" acquired by "delete_volume" :: waited 0.021s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1975a8a1-d948-4c95-ae61-a6b434726365]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:31 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225
Apr 13 11:21:31 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:31 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7" returned: 0 in 0.599s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05905412-6696-4754-89e9-0c3b5a90e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30818701-1003-4162-8f04-7ab7c2896846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:31 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Volume volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 (ba3fb24b-72a6-4422-87a6-020fe781d5c7): created successfully
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30818701-1003-4162-8f04-7ab7c2896846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Flow 'volume_create_manager' (91e24adf-d3da-4c92-82f3-1ebad9fc3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:31 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bf5a0bc5-d2b5-4c15-9b96-3e7f6f8020e7 tempest-ServersNegativeTestJSON-1950004806 None] Created volume successfully.
Apr 13 11:21:31 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225" returned: 0 in 0.734s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:31 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225
Apr 13 11:21:31 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Flow 'volume_create_manager' (37d954e8-7767-451b-b79b-76f3b4ae0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff655d5f-b7cf-4147-bad3-e89cec6cc5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff655d5f-b7cf-4147-bad3-e89cec6cc5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-708557519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b87933-5363-4901-8d3f-f8830a504388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04a20c682c64a36bad187f96ec2021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:32Z,use_quota=True,user_id='85d6a9538338437f879334cdf015cb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6382a554-05ee-4e76-b4b2-1846cecaa3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6382a554-05ee-4e76-b4b2-1846cecaa3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facb058a-55e3-4d04-b02f-f9f8f21e5a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facb058a-55e3-4d04-b02f-f9f8f21e5a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b87933-5363-4901-8d3f-f8830a504388', 'volume_name': 'volume-b8b87933-5363-4901-8d3f-f8830a504388', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c418e36c-b0b8-40b0-a4f8-5cfda0b73906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c418e36c-b0b8-40b0-a4f8-5cfda0b73906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5c5b7d-11ee-4e12-87ca-d2e1839bc10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Volume b8b87933-5363-4901-8d3f-f8830a504388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b87933-5363-4901-8d3f-f8830a504388', 'volume_size': 1}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-708557519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b87933-5363-4901-8d3f-f8830a504388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04a20c682c64a36bad187f96ec2021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:32Z,use_quota=True,user_id='85d6a9538338437f879334cdf015cb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Creating volume b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:32 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:32 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 1073741824
Apr 13 11:21:32 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:32 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Flow 'volume_create_manager' (fa3708ab-c744-4f90-a4cf-22ab334b58d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5843ec12-78a0-4c28-9cb0-e51addcac812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-df9d265b-4f53-4c40-a0bd-dc7d4b7af225" returned: 0 in 1.161s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:32 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 1073741824" returned: 0 in 0.796s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5843ec12-78a0-4c28-9cb0-e51addcac812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1537770210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46d0ba9-61fc-44ca-aca4-9de771ec1e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbe42c24a8484a91029dd45ce55759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:33Z,use_quota=True,user_id='9ab8403da1f04b90acb363a271622b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09477e38-2ec1-4b15-ae14-006f86144638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09477e38-2ec1-4b15-ae14-006f86144638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95bc53f-4241-45d8-b3df-d1d7030c625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95bc53f-4241-45d8-b3df-d1d7030c625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46d0ba9-61fc-44ca-aca4-9de771ec1e5d', 'volume_name': 'volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dbc19b-0ef4-40e0-83bb-46eafb6ca2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dbc19b-0ef4-40e0-83bb-46eafb6ca2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f84b6d-d093-4b8c-8e8f-be56a3ebb77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:32 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Volume d46d0ba9-61fc-44ca-aca4-9de771ec1e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d', 'volume_size': 1}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-quobyte-df9d265b-4f53-4c40-a0bd-dc7d4b7af225" released by "delete_volume" :: held 2.016s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:32 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Created reservations ['4257427e-800f-4fe2-be81-5f7ae36bb18a', 'ae8730ec-4ecd-423a-b6a0-4dedbc5c11ae', '4e100e2f-d257-4b56-ade9-8b94d1f1f022', '904a0b99-73b6-40bd-bcaf-8dfc7f75511c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:32 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:32 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:33 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:33 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:33 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.795s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:33 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Deleted volume successfully.
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bad51e99-be4e-4a7a-a4fb-938a9b0335ea tempest-VolumesListAdminTestJSON-461073897 None] Lock "cinder-df9d265b-4f53-4c40-a0bd-dc7d4b7af225-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:33 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.951s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1537770210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46d0ba9-61fc-44ca-aca4-9de771ec1e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbe42c24a8484a91029dd45ce55759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:33Z,use_quota=True,user_id='9ab8403da1f04b90acb363a271622b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Creating volume d46d0ba9-61fc-44ca-aca4-9de771ec1e5d {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:33 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5c5b7d-11ee-4e12-87ca-d2e1839bc10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b87933-5363-4901-8d3f-f8830a504388', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09404711-1728-4afd-944e-26e6cae9e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:33 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d 1073741824
Apr 13 11:21:34 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Volume volume-b8b87933-5363-4901-8d3f-f8830a504388 (b8b87933-5363-4901-8d3f-f8830a504388): created successfully
Apr 13 11:21:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09404711-1728-4afd-944e-26e6cae9e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Flow 'volume_create_manager' (37d954e8-7767-451b-b79b-76f3b4ae0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0b766ca8-b41d-4ec2-b89f-74fd49fe3d59 tempest-VolumesCloneTest-1675362931 None] Created volume successfully.
Apr 13 11:21:34 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d 1073741824" returned: 0 in 0.728s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:34 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d
Apr 13 11:21:34 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:35 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d" returned: 0 in 0.480s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f84b6d-d093-4b8c-8e8f-be56a3ebb77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a49b58d-bd67-441c-aafb-37a42e6892b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:35 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Volume volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d (d46d0ba9-61fc-44ca-aca4-9de771ec1e5d): created successfully
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a49b58d-bd67-441c-aafb-37a42e6892b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Flow 'volume_create_manager' (fa3708ab-c744-4f90-a4cf-22ab334b58d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-85c3a2fa-6803-4586-ac4e-73a9734e9f1f tempest-ServersNegativeTestJSON-1950004806 None] Created volume successfully.
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Flow 'volume_create_manager' (18f1ac12-2464-4193-b4b6-02e3d6f75b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdc34c1-99e1-4cb4-bd4d-c25b9c257c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdc34c1-99e1-4cb4-bd4d-c25b9c257c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1977930255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e6f2c6-861c-4210-b3e2-a97b126f8c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c04a20c682c64a36bad187f96ec2021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=b8b87933-5363-4901-8d3f-f8830a504388,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:35Z,use_quota=True,user_id='85d6a9538338437f879334cdf015cb38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a938d42b-0801-4ebc-9dc3-d08da61a5638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a938d42b-0801-4ebc-9dc3-d08da61a5638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c379c6d7-23e2-4182-9f98-e762f2ff17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c379c6d7-23e2-4182-9f98-e762f2ff17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a8e6f2c6-861c-4210-b3e2-a97b126f8c5d', 'volume_name': 'volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d', 'volume_size': 2, 'source_volid': 'b8b87933-5363-4901-8d3f-f8830a504388', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364ac9af-daf4-4e53-b723-9600e7c390a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364ac9af-daf4-4e53-b723-9600e7c390a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48ae91a-72cb-4ad2-af6a-9e0fecd68f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:35 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Volume a8e6f2c6-861c-4210-b3e2-a97b126f8c5d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d', 'volume_size': 2, 'source_volid': 'b8b87933-5363-4901-8d3f-f8830a504388', 'source_volstatus': 'available'}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:35 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Cloning volume b8b87933-5363-4901-8d3f-f8830a504388 to volume a8e6f2c6-861c-4210-b3e2-a97b126f8c5d
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Creating offline snapshot 9ee763a9-d9d5-442c-8a2d-f0272cff1966 of volume b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff9d5b-1142-4f34-afb6-5d486765ec58]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:35 devstack sudo[86703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:35 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Flow 'volume_create_manager' (b0949e71-e2b5-4f4b-9769-46b5403c6548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd24af5-38ad-4be8-9dec-01ddc16fc342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd24af5-38ad-4be8-9dec-01ddc16fc342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-794333484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b70f12-6eb1-4f0a-b9b3-47dd367cce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e1072ef1e4459f9b9cddc3c7957df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:36Z,use_quota=True,user_id='17c583f9e8684b2da8e8c35f0bb916b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c192262b-1172-4b07-a324-f5be689d37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c192262b-1172-4b07-a324-f5be689d37a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e719c9-3467-457c-8a10-f4891b70c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e719c9-3467-457c-8a10-f4891b70c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b70f12-6eb1-4f0a-b9b3-47dd367cce9b', 'volume_name': 'volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8abb60-5433-43ae-8080-29916fb932fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8abb60-5433-43ae-8080-29916fb932fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacc31a8-714f-4ee7-9c77-29a89c0107e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Volume 90b70f12-6eb1-4f0a-b9b3-47dd367cce9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b', 'volume_size': 1}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "cinder-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "cinder-quobyte-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-quobyte-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5355b-8772-474b-ad84-73be934e0edc]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:36 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.843s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:36 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 1G
Apr 13 11:21:36 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:36 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d
Apr 13 11:21:36 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Flow 'volume_create_manager' (629de5be-8f5e-4f20-8455-78ef4236355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c28e1b2-b1cf-4482-9579-f871e04705ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c28e1b2-b1cf-4482-9579-f871e04705ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902400202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd54485-733a-4356-bf2a-7b44d2654666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f21f76704c4884b0dbecfae23bd9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:37Z,use_quota=True,user_id='966efa281e0a4cadb94627fa4d5dec49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48da7434-0a02-4636-ac4b-81ce987f902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48da7434-0a02-4636-ac4b-81ce987f902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888dad11-b52b-4928-b6e6-3fb9e1dba5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888dad11-b52b-4928-b6e6-3fb9e1dba5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd54485-733a-4356-bf2a-7b44d2654666', 'volume_name': 'volume-8cd54485-733a-4356-bf2a-7b44d2654666', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3650569b-e276-4528-9fed-0f7ac4317fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3650569b-e276-4528-9fed-0f7ac4317fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fd6618-4e52-4a1f-92cb-80da85ef58fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:37 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Volume 8cd54485-733a-4356-bf2a-7b44d2654666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd54485-733a-4356-bf2a-7b44d2654666', 'volume_size': 1}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:37 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:37 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d" returned: 0 in 0.613s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 1G" returned: 0 in 0.578s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b87933-5363-4901-8d3f-f8830a504388 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:37 devstack sudo[86718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d
Apr 13 11:21:37 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:37 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b87933-5363-4901-8d3f-f8830a504388 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966
Apr 13 11:21:37 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:37 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-quobyte-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d" released by "delete_volume" :: held 1.071s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Created reservations ['957ade5f-d126-4f96-b5af-de188e3778fe', 'de79dcec-b3e5-4f49-9f05-9553d9fa8ad4', 'e50cbdf6-9c80-430c-9a13-73ef644d29e3', '73e4651c-784d-474c-80b4-c038dadf74a6'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:37 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b87933-5363-4901-8d3f-f8830a504388 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:37 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 is being set with open permissions: ugo+rw
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:37 devstack sudo[86727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966
Apr 13 11:21:37 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:37 devstack sudo[86729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:37 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:38 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:38 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:38 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info
Apr 13 11:21:38 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.447s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Deleted volume successfully.
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5c679d8a-7c33-4171-8cd0-23d2463c70ea tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-d46d0ba9-61fc-44ca-aca4-9de771ec1e5d-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:38 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info" returned: 0 in 0.456s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:38 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info is being set with open permissions: ugo+rw
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:38 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info
Apr 13 11:21:38 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "cinder-ba3fb24b-72a6-4422-87a6-020fe781d5c7-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-ba3fb24b-72a6-4422-87a6-020fe781d5c7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "cinder-quobyte-ba3fb24b-72a6-4422-87a6-020fe781d5c7" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-quobyte-ba3fb24b-72a6-4422-87a6-020fe781d5c7" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8934b2e-f45a-49b9-a06c-e015d9f79322]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:38 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7
Apr 13 11:21:38 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:38 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.info" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Acquiring lock "cinder-quobyte-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] snapshot: 9ee763a9-d9d5-442c-8a2d-f0272cff1966, volume: a8e6f2c6-861c-4210-b3e2-a97b126f8c5d,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f733d-de6d-4016-9f23-fc64748d7e45]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:39 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966
Apr 13 11:21:39 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:39 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7" returned: 0 in 0.507s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:39 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7
Apr 13 11:21:39 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:39 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966" returned: 0 in 0.537s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b87933-5363-4901-8d3f-f8830a504388(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27e97cc-c6ba-445b-a371-ba6b9ede3fb9]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:39 devstack sudo[86753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:39 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:39 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba3fb24b-72a6-4422-87a6-020fe781d5c7" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-quobyte-ba3fb24b-72a6-4422-87a6-020fe781d5c7" released by "delete_volume" :: held 1.018s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Created reservations ['9a04f312-d67c-4128-b657-ae91f14429a2', '0232320b-d53a-483d-8b00-5a1399c0a4a8', 'b4e431f8-7db2-4a0a-bbc7-2998c112b117', '6ce3fb28-3903-4607-8947-e4a068053391'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:39 devstack sudo[86757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:39 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:40 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.588s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:40 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:21:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:40 devstack sudo[86763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d
Apr 13 11:21:40 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:40 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.450s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:40 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Deleted volume successfully.
Apr 13 11:21:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8f95a10e-2394-4c01-bc91-418feb25d113 tempest-ServersNegativeTestJSON-1950004806 None] Lock "cinder-ba3fb24b-72a6-4422-87a6-020fe781d5c7-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:42 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" returned: 0 in 2.757s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:42 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[073d64fb-47ed-4fe0-854c-58eed1aa6c92]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:42 devstack sudo[86802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:42 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:43 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.670s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:43 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:21:43 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Converted 1024.00 MB image at 371.36 MB/s
Apr 13 11:21:43 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d is being set with open permissions: ugo+rw
Apr 13 11:21:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:43 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d
Apr 13 11:21:43 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:44 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" returned: 0 in 0.479s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" released by "_copy_volume_from_snapshot" :: held 5.083s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Acquiring lock "cinder-quobyte-9ee763a9-d9d5-442c-8a2d-f0272cff1966" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-9ee763a9-d9d5-442c-8a2d-f0272cff1966" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Deleting offline snapshot 9ee763a9-d9d5-442c-8a2d-f0272cff1966 of volume b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] snapshot_file for this snap is: volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed27bf3-74c0-4866-b56d-bb802d21b238]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:44 devstack sudo[86814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966
Apr 13 11:21:44 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:44 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966" returned: 0 in 0.530s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b87933-5363-4901-8d3f-f8830a504388(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa254000-1e72-4119-a131-6a057ee01b81]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:44 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:44 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:45 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.550s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:45 devstack sudo[86824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966
Apr 13 11:21:45 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:45 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:45 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966
Apr 13 11:21:45 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:46 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388.9ee763a9-d9d5-442c-8a2d-f0272cff1966" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-9ee763a9-d9d5-442c-8a2d-f0272cff1966" released by "_delete_snapshot" :: held 2.035s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.497s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.780s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-794333484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b70f12-6eb1-4f0a-b9b3-47dd367cce9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e1072ef1e4459f9b9cddc3c7957df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:36Z,use_quota=True,user_id='17c583f9e8684b2da8e8c35f0bb916b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Creating volume 90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:46 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48ae91a-72cb-4ad2-af6a-9e0fecd68f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d', 'volume_size': 2, 'source_volid': 'b8b87933-5363-4901-8d3f-f8830a504388', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:46 devstack sudo[86832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b 1073741824
Apr 13 11:21:46 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ba70e6-1720-4743-8fef-71f41fec8208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:46 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Volume volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d (a8e6f2c6-861c-4210-b3e2-a97b126f8c5d): created successfully
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ba70e6-1720-4743-8fef-71f41fec8208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Flow 'volume_create_manager' (18f1ac12-2464-4193-b4b6-02e3d6f75b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:46 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-cb49f476-8c74-4c2b-8894-f906a5f27cea tempest-VolumesCloneTest-1675362931 None] Created volume successfully.
Apr 13 11:21:46 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b 1073741824" returned: 0 in 0.535s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:46 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:21:46 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:47 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.402s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.026s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1902400202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd54485-733a-4356-bf2a-7b44d2654666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f21f76704c4884b0dbecfae23bd9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:37Z,use_quota=True,user_id='966efa281e0a4cadb94627fa4d5dec49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Creating volume 8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:47 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacc31a8-714f-4ee7-9c77-29a89c0107e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:47 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 1073741824
Apr 13 11:21:47 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60eab866-85d2-466a-9ded-f0efbff437bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:47 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Volume volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b (90b70f12-6eb1-4f0a-b9b3-47dd367cce9b): created successfully
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60eab866-85d2-466a-9ded-f0efbff437bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Flow 'volume_create_manager' (b0949e71-e2b5-4f4b-9769-46b5403c6548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:47 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-acbad9f9-a589-402b-b66a-6c810714a6f5 tempest-SnapshotDependencyTests-1910793567 None] Created volume successfully.
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "cinder-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "cinder-quobyte-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff6c43-afb9-46d0-9a8e-feae05099bc0]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:47 devstack sudo[86843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d
Apr 13 11:21:47 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:47 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 1073741824" returned: 0 in 0.569s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:47 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666
Apr 13 11:21:47 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:48 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" returned: 0 in 0.584s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:48 devstack sudo[86853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d
Apr 13 11:21:48 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:48 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666" returned: 0 in 0.503s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fd6618-4e52-4a1f-92cb-80da85ef58fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd54485-733a-4356-bf2a-7b44d2654666', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6427821-b4f1-4245-8c92-38f740dc082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:48 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Volume volume-8cd54485-733a-4356-bf2a-7b44d2654666 (8cd54485-733a-4356-bf2a-7b44d2654666): created successfully
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6427821-b4f1-4245-8c92-38f740dc082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Flow 'volume_create_manager' (629de5be-8f5e-4f20-8455-78ef4236355b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-24e70701-bd0c-4754-b62e-b4ed8be14511 tempest-VolumesDeleteCascade-1356668038 None] Created volume successfully.
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Creating offline snapshot de8c116a-a831-48ff-a58b-36d6a6ba39b2 of volume 90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9fdd3-899e-40ec-ab0d-65bf0adea0d5]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:48 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:21:48 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:48 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" returned: 0 in 0.547s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d" released by "delete_volume" :: held 1.154s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Created reservations ['2ae8553d-1258-423f-9b30-2e4ad9b8e405', 'de86c40c-55eb-4e5f-bf3b-66d06639093a', 'df3e6a14-8d6f-4e1f-8e8c-84ce4d321aad', '492edc31-49e2-4b5e-93d2-f3b3f592c129'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:48 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:48 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:48 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.568s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:48 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 1G
Apr 13 11:21:48 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:49 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.535s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:49 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Deleted volume successfully.
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-766022ee-eabb-40fa-80aa-c284cd270f53 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-a8e6f2c6-861c-4210-b3e2-a97b126f8c5d-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:49 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 1G" returned: 0 in 0.622s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:49 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2
Apr 13 11:21:49 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "cinder-b8b87933-5363-4901-8d3f-f8830a504388-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-b8b87933-5363-4901-8d3f-f8830a504388-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "cinder-quobyte-b8b87933-5363-4901-8d3f-f8830a504388" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-b8b87933-5363-4901-8d3f-f8830a504388" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c820c421-d5c7-49f7-a5d4-14a6fdbddbed]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:49 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:49 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:49 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:50 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 is being set with open permissions: ugo+rw
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:50 devstack sudo[86879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2
Apr 13 11:21:50 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:50 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.556s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:50 devstack sudo[86884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388
Apr 13 11:21:50 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:50 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2" returned: 0 in 0.498s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:50 devstack sudo[86887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info
Apr 13 11:21:50 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:50 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8b87933-5363-4901-8d3f-f8830a504388" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-quobyte-b8b87933-5363-4901-8d3f-f8830a504388" released by "delete_volume" :: held 1.075s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Created reservations ['26b4a023-c98f-4f20-b677-f5894ffcbb83', '5858acfc-e6f6-4fc9-8e2e-4259983e423a', '66d30b7f-25f3-4640-86df-ccd50c1ebeee', '3addcc6e-fc7b-410c-b3fb-3c1ce20713b5'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:50 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:21:50 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:51 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info" returned: 0 in 0.525s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:51 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info is being set with open permissions: ugo+rw
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:51 devstack sudo[86893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info
Apr 13 11:21:51 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:51 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:21:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Deleted volume successfully.
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-20d1560f-cce8-4dbc-bed3-17621d77f470 tempest-VolumesCloneTest-1675362931 None] Lock "cinder-b8b87933-5363-4901-8d3f-f8830a504388-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:21:51 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.info" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.291s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.635s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Creating offline snapshot f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d of volume 8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1845350c-4c90-4e0c-bc5b-fbd4301a14c7]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a3657261-b687-474d-ba54-656f5476e9d5 tempest-SnapshotDependencyTests-1910793567 None] Create snapshot completed successfully
Apr 13 11:21:51 devstack sudo[86897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666
Apr 13 11:21:51 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Flow 'volume_create_manager' (57209603-9cbb-4e66-8d59-6b95ec1b18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2334991b-7ad2-47ad-9b28-b95c408ee24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2334991b-7ad2-47ad-9b28-b95c408ee24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-9281171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d30930-d83d-4873-87d9-934c233e29b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='138d2992fbec42cb94a87e8806aff993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:52Z,use_quota=True,user_id='f055127d89b8480d930f4a79909d14eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2f71ac-bc2f-49dc-bead-d6ecbe63f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2f71ac-bc2f-49dc-bead-d6ecbe63f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a3fdad-2021-4431-ab0d-261add94ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a3fdad-2021-4431-ab0d-261add94ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d30930-d83d-4873-87d9-934c233e29b5', 'volume_name': 'volume-72d30930-d83d-4873-87d9-934c233e29b5', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f8fe4a-7a53-4860-860d-85d74bd6fc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f8fe4a-7a53-4860-860d-85d74bd6fc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3116428d-ff87-4594-801e-a9be16b0d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Volume 72d30930-d83d-4873-87d9-934c233e29b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d30930-d83d-4873-87d9-934c233e29b5', 'volume_size': 1}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:52 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666" returned: 0 in 0.626s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:52 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d 1G
Apr 13 11:21:52 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Flow 'volume_create_manager' (9ac60c9e-5ca6-48a6-ba2f-0c8d6530fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d3de5f-1cc3-4696-bd8f-8a198ac5421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d3de5f-1cc3-4696-bd8f-8a198ac5421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b3a343-3c89-4015-9e84-50ad16b63d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e1072ef1e4459f9b9cddc3c7957df7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de8c116a-a831-48ff-a58b-36d6a6ba39b2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:53Z,use_quota=True,user_id='17c583f9e8684b2da8e8c35f0bb916b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be686b7f-45c7-416e-aaa1-aec9fe11c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be686b7f-45c7-416e-aaa1-aec9fe11c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37d6a57-4446-49f7-84c8-cc4f6e02a14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37d6a57-4446-49f7-84c8-cc4f6e02a14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a5b3a343-3c89-4015-9e84-50ad16b63d1c', 'volume_name': 'volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c', 'volume_size': 1, 'snapshot_id': 'de8c116a-a831-48ff-a58b-36d6a6ba39b2'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb04e3d-1861-4bf1-ab97-c858ddd27c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb04e3d-1861-4bf1-ab97-c858ddd27c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427bbef8-96fd-4fb8-a695-a73e98db4e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:52 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Volume a5b3a343-3c89-4015-9e84-50ad16b63d1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c', 'volume_size': 1, 'snapshot_id': 'de8c116a-a831-48ff-a58b-36d6a6ba39b2'}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d 1G" returned: 0 in 0.680s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd54485-733a-4356-bf2a-7b44d2654666 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:52 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd54485-733a-4356-bf2a-7b44d2654666 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:21:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:52 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:53 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd54485-733a-4356-bf2a-7b44d2654666 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.480s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:53 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d is being set with open permissions: ugo+rw
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:53 devstack sudo[86912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:21:53 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Flow 'volume_create_manager' (8e1e2c6a-b12f-494e-bf4e-bfe96ecf5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624e2063-e36e-446f-812c-3bfe6b7a9f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624e2063-e36e-446f-812c-3bfe6b7a9f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-892124738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e216b199-4f3e-4e81-a31f-efa8ae12ac1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99a76464f6cd40e5aed1cdfb76328639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:54Z,use_quota=True,user_id='c0d97cfccd39486c89a9dd37189ddfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24867d8d-9b84-40f7-8fa2-403d05e2f223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24867d8d-9b84-40f7-8fa2-403d05e2f223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf8ac6b-afbc-46b1-85d4-19a80e7edc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf8ac6b-afbc-46b1-85d4-19a80e7edc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e216b199-4f3e-4e81-a31f-efa8ae12ac1c', 'volume_name': 'volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5a8471-ff38-4760-a35f-e585379239d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5a8471-ff38-4760-a35f-e585379239d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e19f0be-bb94-42cc-a27f-7c8942adcab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:53 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Volume e216b199-4f3e-4e81-a31f-efa8ae12ac1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c', 'volume_size': 1}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:53 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.425s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:53 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info
Apr 13 11:21:53 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:54 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info" returned: 0 in 0.435s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:54 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info is being set with open permissions: ugo+rw
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:54 devstack sudo[86918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info
Apr 13 11:21:54 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:54 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.info" returned: 0 in 0.446s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.590s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-9281171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d30930-d83d-4873-87d9-934c233e29b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='138d2992fbec42cb94a87e8806aff993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:52Z,use_quota=True,user_id='f055127d89b8480d930f4a79909d14eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Creating volume 72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:54 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:21:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:54 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 1073741824
Apr 13 11:21:54 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-db389d13-d44c-468a-a6fd-6f1a8899cf64 tempest-VolumesDeleteCascade-1356668038 None] Create snapshot completed successfully
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:55 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 1073741824" returned: 0 in 0.612s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:55 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5
Apr 13 11:21:55 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:55 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.906s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-quobyte-de8c116a-a831-48ff-a58b-36d6a6ba39b2-a5b3a343-3c89-4015-9e84-50ad16b63d1c" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3116428d-ff87-4594-801e-a9be16b0d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d30930-d83d-4873-87d9-934c233e29b5', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb126470-f085-44c5-a296-c0f2637d81dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-de8c116a-a831-48ff-a58b-36d6a6ba39b2-a5b3a343-3c89-4015-9e84-50ad16b63d1c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Creating volume a5b3a343-3c89-4015-9e84-50ad16b63d1c from snapshot de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-quobyte-a5b3a343-3c89-4015-9e84-50ad16b63d1c" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:21:55 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Volume volume-72d30930-d83d-4873-87d9-934c233e29b5 (72d30930-d83d-4873-87d9-934c233e29b5): created successfully
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb126470-f085-44c5-a296-c0f2637d81dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Flow 'volume_create_manager' (57209603-9cbb-4e66-8d59-6b95ec1b18e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-a5b3a343-3c89-4015-9e84-50ad16b63d1c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] snapshot: de8c116a-a831-48ff-a58b-36d6a6ba39b2, volume: a5b3a343-3c89-4015-9e84-50ad16b63d1c,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:21:55 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-04345747-2e71-44a6-8167-c18c7dcdc97b req-897a3980-3fa7-4acc-9cb1-a49d5f42b7a8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Created volume successfully.
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d28dc7-56bc-4361-897e-733a4054061f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:56 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2
Apr 13 11:21:56 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:56 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dacb7f-ce43-4de4-9a67-ceac7c5bdb37]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:56 devstack sudo[86934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:21:56 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:21:57 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.539s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:57 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:21:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:57 devstack sudo[86939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c
Apr 13 11:21:57 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:59 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c" returned: 0 in 2.071s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:59 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[432885af-ee19-4457-b929-d19b458a547a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:21:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:59 devstack sudo[86952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:21:59 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:21:59 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root
Apr 13 11:21:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.574s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:21:59 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:21:59 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Converted 1024.00 MB image at 494.22 MB/s
Apr 13 11:21:59 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c is being set with open permissions: ugo+rw
Apr 13 11:21:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:21:59 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c
Apr 13 11:21:59 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:00 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c" returned: 0 in 0.418s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-a5b3a343-3c89-4015-9e84-50ad16b63d1c" released by "_copy_volume_from_snapshot" :: held 4.191s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-de8c116a-a831-48ff-a58b-36d6a6ba39b2-a5b3a343-3c89-4015-9e84-50ad16b63d1c" released by "_create_volume_from_snapshot" :: held 4.229s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.253s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.396s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-892124738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e216b199-4f3e-4e81-a31f-efa8ae12ac1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99a76464f6cd40e5aed1cdfb76328639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:21:54Z,use_quota=True,user_id='c0d97cfccd39486c89a9dd37189ddfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Creating volume e216b199-4f3e-4e81-a31f-efa8ae12ac1c {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:00 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:00 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c 1073741824
Apr 13 11:22:00 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427bbef8-96fd-4fb8-a695-a73e98db4e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c', 'volume_size': 1, 'snapshot_id': 'de8c116a-a831-48ff-a58b-36d6a6ba39b2'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d87e929-0433-4025-862a-2352078919ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:00 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Volume volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c (a5b3a343-3c89-4015-9e84-50ad16b63d1c): created successfully
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d87e929-0433-4025-862a-2352078919ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Flow 'volume_create_manager' (9ac60c9e-5ca6-48a6-ba2f-0c8d6530fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:00 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a04c7477-e3e7-4367-bc82-c1742230a536 tempest-SnapshotDependencyTests-1910793567 None] Created volume successfully.
Apr 13 11:22:00 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c 1073741824" returned: 0 in 0.538s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:00 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c
Apr 13 11:22:00 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:01 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c" returned: 0 in 0.441s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.877s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Creating offline snapshot f09143eb-0160-47cb-a454-292bc813c6dd of volume 8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e19f0be-bb94-42cc-a27f-7c8942adcab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab76cd2e-68eb-4c39-b3c8-ef3275aedafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f364c389-1e88-43ed-90a1-d5700f465e02]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:01 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Volume volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c (e216b199-4f3e-4e81-a31f-efa8ae12ac1c): created successfully
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab76cd2e-68eb-4c39-b3c8-ef3275aedafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Flow 'volume_create_manager' (8e1e2c6a-b12f-494e-bf4e-bfe96ecf5544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:01 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f1091570-2f23-4b4c-9f0e-a8a624faf6eb tempest-VolumesListTestJSON-1770984360 None] Created volume successfully.
Apr 13 11:22:01 devstack sudo[86968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:22:01 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-de8c116a-a831-48ff-a58b-36d6a6ba39b2-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-de8c116a-a831-48ff-a58b-36d6a6ba39b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-quobyte-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-quobyte-de8c116a-a831-48ff-a58b-36d6a6ba39b2" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-de8c116a-a831-48ff-a58b-36d6a6ba39b2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Deleting offline snapshot de8c116a-a831-48ff-a58b-36d6a6ba39b2 of volume 90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] snapshot_file for this snap is: volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b7164-62e6-4981-9bc0-99bdc6b7dea6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:01 devstack sudo[86970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2
Apr 13 11:22:01 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:01 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.572s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cd54485-733a-4356-bf2a-7b44d2654666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:01 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd 1G
Apr 13 11:22:01 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:01 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2" returned: 0 in 0.506s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6787ed70-61db-4cc2-9fa7-31e5aa3274f9]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:01 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:22:01 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:02 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd 1G" returned: 0 in 0.613s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:02 devstack sudo[86990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd
Apr 13 11:22:02 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:02 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.533s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:02 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2
Apr 13 11:22:02 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Flow 'volume_create_manager' (e19fa459-5b79-463a-abff-a01f62e83108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226efdc9-7a66-4ce9-80a0-6cd64f378ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226efdc9-7a66-4ce9-80a0-6cd64f378ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296794545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13377afa-8826-4c35-b8ff-4fc749f3f544,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99a76464f6cd40e5aed1cdfb76328639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:02Z,use_quota=True,user_id='c0d97cfccd39486c89a9dd37189ddfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e9457e-2619-4d54-9685-db5b0082605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e9457e-2619-4d54-9685-db5b0082605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d1f1b6-96ab-46d1-be0f-7d9341daee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d1f1b6-96ab-46d1-be0f-7d9341daee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13377afa-8826-4c35-b8ff-4fc749f3f544', 'volume_name': 'volume-13377afa-8826-4c35-b8ff-4fc749f3f544', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f768d77-5e53-4bda-8045-2f7348f6f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f768d77-5e53-4bda-8045-2f7348f6f190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27e06a0-bcdd-4d39-a536-15da79652175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:02 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Volume 13377afa-8826-4c35-b8ff-4fc749f3f544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13377afa-8826-4c35-b8ff-4fc749f3f544', 'volume_size': 1}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:02 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd" returned: 0 in 0.479s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:02 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd is being set with open permissions: ugo+rw
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:02 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd
Apr 13 11:22:02 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:02 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2" returned: 0 in 0.478s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:02 devstack sudo[87002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2
Apr 13 11:22:02 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:03 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd" returned: 0 in 0.456s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.728s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Creating offline snapshot 0dcbd515-9903-440b-896e-0dc8f0b84745 of volume 72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:22:03 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1e07c1fa-1e87-431a-b5ec-81afd862d5bd tempest-VolumesDeleteCascade-1356668038 None] Create snapshot completed successfully
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1812fc-dff8-46d3-b070-17a3ab6e6cd9]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:03 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b.de8c116a-a831-48ff-a58b-36d6a6ba39b2" returned: 0 in 0.506s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-de8c116a-a831-48ff-a58b-36d6a6ba39b2" released by "_delete_snapshot" :: held 2.080s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" released by "delete_snapshot" :: held 2.094s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:03 devstack sudo[87006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5
Apr 13 11:22:03 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Created reservations ['f02f4680-37df-4c3e-b99f-fbcc48ef31b6', 'bee20b54-8dcc-4bcb-aae4-b49ccccace1b', 'b8687333-2cce-4812-93d5-592fa8b460e9', '4892db60-6b18-4253-afb0-0a80f73167cb'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:03 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Delete snapshot completed successfully.
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-638bdfa5-d61f-4795-b7b6-b614b71c3ae1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-de8c116a-a831-48ff-a58b-36d6a6ba39b2-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-8cd54485-733a-4356-bf2a-7b44d2654666-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-8cd54485-733a-4356-bf2a-7b44d2654666-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Performing cascade delete. {{(pid=82099) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-f09143eb-0160-47cb-a454-292bc813c6dd-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-f09143eb-0160-47cb-a454-292bc813c6dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-f09143eb-0160-47cb-a454-292bc813c6dd" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-f09143eb-0160-47cb-a454-292bc813c6dd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Deleting offline snapshot f09143eb-0160-47cb-a454-292bc813c6dd of volume 8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] snapshot_file for this snap is: volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b661fa1-0221-4780-af9f-bdd6821c813e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:03 devstack sudo[87008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd
Apr 13 11:22:03 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:03 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5" returned: 0 in 0.550s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:03 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 1G
Apr 13 11:22:03 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:04 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd" returned: 0 in 0.532s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cd54485-733a-4356-bf2a-7b44d2654666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdf779d-a44e-4b38-a90b-a8c94a05b7f1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:04 devstack sudo[87018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:22:04 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:04 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-quobyte-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 1G" returned: 0 in 0.583s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d30930-d83d-4873-87d9-934c233e29b5 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" acquired by "delete_volume" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:04 devstack sudo[87023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d30930-d83d-4873-87d9-934c233e29b5 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745
Apr 13 11:22:04 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[46abf48a-e1de-48c4-b37d-1d28cd399b08]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:04 devstack sudo[87025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:22:04 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:04 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cd54485-733a-4356-bf2a-7b44d2654666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:04 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd
Apr 13 11:22:04 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:04 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d30930-d83d-4873-87d9-934c233e29b5 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745" returned: 0 in 0.449s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:04 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 is being set with open permissions: ugo+rw
Apr 13 11:22:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:04 devstack sudo[87035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745
Apr 13 11:22:04 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:05 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.506s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:05 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b
Apr 13 11:22:05 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:05 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd" returned: 0 in 0.505s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:05 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd
Apr 13 11:22:05 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:05 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745" returned: 0 in 0.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:05 devstack sudo[87048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info
Apr 13 11:22:05 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:05 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" returned: 0 in 0.426s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b" released by "delete_volume" :: held 0.977s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Created reservations ['5f38c29b-00f4-49c5-a956-6ab09159deb3', '436b5720-3b09-46bd-8b02-7533c10a29a0', '98783e89-c2e8-4b1c-ae42-73396e17cf3a', '5e836cd1-a1c5-4a93-a7ec-282c42c89a5a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:05 devstack sudo[87051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:05 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:05 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f09143eb-0160-47cb-a454-292bc813c6dd" returned: 0 in 0.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-f09143eb-0160-47cb-a454-292bc813c6dd" released by "_delete_snapshot" :: held 2.109s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" released by "delete_snapshot" :: held 2.121s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Created reservations ['e877459b-d8b5-4e19-9d33-dd8eacb4d580', '8ee2886b-7e8f-4226-858c-c636dd69444d', 'ac55d8f0-53ab-4ae2-844c-44f67f4ff8e2', 'e07496c2-4a09-4cd5-86e5-b3733cdbe057'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Delete snapshot completed successfully.
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-f09143eb-0160-47cb-a454-292bc813c6dd-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:05 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info" returned: 0 in 0.457s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:05 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info is being set with open permissions: ugo+rw
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:05 devstack sudo[87055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info
Apr 13 11:22:05 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Deleting offline snapshot f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d of volume 8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] snapshot_file for this snap is: volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecec05f-a9d8-4257-b3d6-11f93c0b816a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:06 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:22:06 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:06 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:06 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Deleted volume successfully.
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4935cd7c-277d-4b1c-93a3-aae0652e01e1 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-90b70f12-6eb1-4f0a-b9b3-47dd367cce9b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:06 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.info" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.978s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.764s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1296794545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13377afa-8826-4c35-b8ff-4fc749f3f544,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99a76464f6cd40e5aed1cdfb76328639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:02Z,use_quota=True,user_id='c0d97cfccd39486c89a9dd37189ddfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Creating volume 13377afa-8826-4c35-b8ff-4fc749f3f544 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:06 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:06 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544 1073741824
Apr 13 11:22:06 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:06 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-4ddd0516-62c1-4cfd-9980-909befb9019b req-5e16befd-debc-459a-b0c6-7571951a8cb8 tempest-VolumesSnapshotsTestJSON-2099379479 None] Create snapshot completed successfully
Apr 13 11:22:06 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cd54485-733a-4356-bf2a-7b44d2654666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[260db20f-bda9-44cc-86c7-adf168912522]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:06 devstack sudo[87072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666
Apr 13 11:22:06 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-a5b3a343-3c89-4015-9e84-50ad16b63d1c-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-a5b3a343-3c89-4015-9e84-50ad16b63d1c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "cinder-quobyte-a5b3a343-3c89-4015-9e84-50ad16b63d1c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-a5b3a343-3c89-4015-9e84-50ad16b63d1c" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b3aa7-a469-492b-ba25-1c446f19833d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:06 devstack sudo[87075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c
Apr 13 11:22:06 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:06 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544 1073741824" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:06 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544
Apr 13 11:22:06 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:07 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666" returned: 0 in 0.550s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:07 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:22:07 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:07 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:07 devstack sudo[87089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c
Apr 13 11:22:07 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:07 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544" returned: 0 in 0.417s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27e06a0-bcdd-4d39-a536-15da79652175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13377afa-8826-4c35-b8ff-4fc749f3f544', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56986762-7963-4119-9e88-c88cfb8108f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:07 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Volume volume-13377afa-8826-4c35-b8ff-4fc749f3f544 (13377afa-8826-4c35-b8ff-4fc749f3f544): created successfully
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56986762-7963-4119-9e88-c88cfb8108f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Flow 'volume_create_manager' (e19fa459-5b79-463a-abff-a01f62e83108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:07 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1732998b-ad18-475a-b6af-200eb5e0ef34 tempest-VolumesListTestJSON-1770984360 None] Created volume successfully.
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "cinder-0dcbd515-9903-440b-896e-0dc8f0b84745-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-0dcbd515-9903-440b-896e-0dc8f0b84745-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "cinder-quobyte-72d30930-d83d-4873-87d9-934c233e29b5" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-quobyte-72d30930-d83d-4873-87d9-934c233e29b5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "cinder-quobyte-0dcbd515-9903-440b-896e-0dc8f0b84745" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-quobyte-0dcbd515-9903-440b-896e-0dc8f0b84745" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Deleting offline snapshot 0dcbd515-9903-440b-896e-0dc8f0b84745 of volume 72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] snapshot_file for this snap is: volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a755939-ba5d-4daa-84d0-c36820b8785d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:07 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:07 devstack sudo[87097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d
Apr 13 11:22:07 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:07 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745
Apr 13 11:22:07 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:07 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a5b3a343-3c89-4015-9e84-50ad16b63d1c" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-quobyte-a5b3a343-3c89-4015-9e84-50ad16b63d1c" released by "delete_volume" :: held 1.006s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Created reservations ['6c4d195d-4938-4e36-b559-16d83b8cc606', '88712263-7c7d-499e-bb90-ebd63186cf90', 'f8060b93-e918-4148-8b84-2af161553e4a', 'b68792ca-eadb-432b-8134-7c463cb130e7'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:07 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:07 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:07 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666.f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" returned: 0 in 0.465s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d" released by "_delete_snapshot" :: held 2.104s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" released by "delete_snapshot" :: held 2.117s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:08 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Flow 'volume_create_manager' (32fa3d78-7a7a-4423-9542-e9f11e5204cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5a7da5-17b0-4744-9f83-0654208b2005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745" returned: 0 in 0.629s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d30930-d83d-4873-87d9-934c233e29b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5a7da5-17b0-4744-9f83-0654208b2005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1340935020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b899381c-2323-4248-809b-374347d95694,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99a76464f6cd40e5aed1cdfb76328639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:08Z,use_quota=True,user_id='c0d97cfccd39486c89a9dd37189ddfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8220a8f0-db2a-4a86-ba3d-aa8a715075a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8220a8f0-db2a-4a86-ba3d-aa8a715075a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c3d531-196b-476f-a3e6-d087d72f2fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c3d531-196b-476f-a3e6-d087d72f2fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b899381c-2323-4248-809b-374347d95694', 'volume_name': 'volume-b899381c-2323-4248-809b-374347d95694', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26be0622-92ba-4e4d-9636-3c4719bc8eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26be0622-92ba-4e4d-9636-3c4719bc8eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d493d0d8-e6a0-40e8-b56f-5251c427585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:08 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Volume b899381c-2323-4248-809b-374347d95694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b899381c-2323-4248-809b-374347d95694', 'volume_size': 1}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1340935020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b899381c-2323-4248-809b-374347d95694,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='99a76464f6cd40e5aed1cdfb76328639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:08Z,use_quota=True,user_id='c0d97cfccd39486c89a9dd37189ddfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Creating volume b899381c-2323-4248-809b-374347d95694 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:08 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7e3a1-d271-4a25-b503-a0d202af97ae]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:08 devstack sudo[87107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694 1073741824
Apr 13 11:22:08 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Created reservations ['47968570-af0e-4532-b4a1-7e41063e88ce', 'e24f46c2-96ae-421e-9ea0-df6b8a360056', '43471ebb-7ad5-4242-bb45-dd38031ff28b', 'd766f529-d19b-458a-92ab-2138e780fdd2'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Delete snapshot completed successfully.
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-f37d18dd-fd47-4dbf-8b0b-3d55956c6c6d-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Snapshots deleted, issuing volume delete {{(pid=82099) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4cb2df-2645-4b47-992b-a9db29015010]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:08 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5
Apr 13 11:22:08 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:08 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Deleted volume successfully.
Apr 13 11:22:08 devstack sudo[87112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666
Apr 13 11:22:08 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0964ed03-8da6-4f75-a381-5b97d0b849a9 tempest-SnapshotDependencyTests-1910793567 None] Lock "cinder-a5b3a343-3c89-4015-9e84-50ad16b63d1c-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:08 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694 1073741824" returned: 0 in 0.484s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:08 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694
Apr 13 11:22:08 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:08 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5" returned: 0 in 0.549s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:08 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745
Apr 13 11:22:08 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:08 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666" returned: 0 in 0.562s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:08 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666
Apr 13 11:22:08 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:09 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694" returned: 0 in 0.468s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d493d0d8-e6a0-40e8-b56f-5251c427585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b899381c-2323-4248-809b-374347d95694', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e37cd04-5eef-4993-9c33-cffc5b613d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:09 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Volume volume-b899381c-2323-4248-809b-374347d95694 (b899381c-2323-4248-809b-374347d95694): created successfully
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e37cd04-5eef-4993-9c33-cffc5b613d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Flow 'volume_create_manager' (32fa3d78-7a7a-4423-9542-e9f11e5204cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-aea670fa-83e9-48d8-80cf-63fc7171bdd6 tempest-VolumesListTestJSON-1770984360 None] Created volume successfully.
Apr 13 11:22:09 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745" returned: 0 in 0.573s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:09 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8cd54485-733a-4356-bf2a-7b44d2654666" returned: 0 in 0.501s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:09 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745
Apr 13 11:22:09 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8cd54485-733a-4356-bf2a-7b44d2654666" released by "delete_volume" :: held 1.095s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Created reservations ['113325c3-61d8-45f8-b8f4-e376b474097a', '9705c4e9-ea4f-41f2-8321-1a256675fe44', '08b79a5e-1635-4c9b-91e9-4fe10cde7db0', 'eda58b14-eda1-4fe5-bac5-95ba0f01ea4b'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:09 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:09 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:09 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5.0dcbd515-9903-440b-896e-0dc8f0b84745" returned: 0 in 0.476s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-quobyte-0dcbd515-9903-440b-896e-0dc8f0b84745" released by "_delete_snapshot" :: held 2.337s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-quobyte-72d30930-d83d-4873-87d9-934c233e29b5" released by "delete_snapshot" :: held 2.350s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.quota [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Created reservations ['1787579e-2660-42af-a002-9f952a9bcc45', '13fb72da-7222-4633-9c71-4c2144eafdf6', '13c4140c-7086-4906-ac57-77a1a89ab837', '04ca9741-b7b3-417f-9c58-038479383b1c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Delete snapshot completed successfully.
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-151f6b55-e7c1-40da-9ec5-6f9d1084fbf6 req-236719b8-4073-4409-863a-8c84711bad24 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-0dcbd515-9903-440b-896e-0dc8f0b84745-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:09 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.484s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Deleted volume successfully.
Apr 13 11:22:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-420b413d-93cc-484e-9274-e9d14fde0f9b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-8cd54485-733a-4356-bf2a-7b44d2654666-delete_volume" released by "delete_volume" :: held 6.358s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Flow 'volume_create_manager' (fa5254d0-1f64-4d69-8f06-13262bc50ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e5695f-b07d-47b7-b699-1578b9edbee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e5695f-b07d-47b7-b699-1578b9edbee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-542910324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df2db3c-7d30-466e-86d3-a2be83176a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f21f76704c4884b0dbecfae23bd9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:10Z,use_quota=True,user_id='966efa281e0a4cadb94627fa4d5dec49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71d6650-d72a-40ac-8dae-9b8f704b5220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71d6650-d72a-40ac-8dae-9b8f704b5220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a2bbb2-092e-4ff6-a56b-7d43985cf114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a2bbb2-092e-4ff6-a56b-7d43985cf114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df2db3c-7d30-466e-86d3-a2be83176a0f', 'volume_name': 'volume-6df2db3c-7d30-466e-86d3-a2be83176a0f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c5ef7c-52e4-4a1e-a966-74b2a4475b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c5ef7c-52e4-4a1e-a966-74b2a4475b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38feed9-bda9-40ba-9c4b-1dbcb94b7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:10 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Volume 6df2db3c-7d30-466e-86d3-a2be83176a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df2db3c-7d30-466e-86d3-a2be83176a0f', 'volume_size': 1}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-542910324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df2db3c-7d30-466e-86d3-a2be83176a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f21f76704c4884b0dbecfae23bd9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:10Z,use_quota=True,user_id='966efa281e0a4cadb94627fa4d5dec49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Creating volume 6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:10 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:10 devstack sudo[87141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f 1073741824
Apr 13 11:22:10 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "cinder-72d30930-d83d-4873-87d9-934c233e29b5-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-72d30930-d83d-4873-87d9-934c233e29b5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:10 devstack sudo[87143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:10 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "cinder-quobyte-72d30930-d83d-4873-87d9-934c233e29b5" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-quobyte-72d30930-d83d-4873-87d9-934c233e29b5" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae04406f-981e-46c0-81e9-d2436bef8373]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:10 devstack sudo[87145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5
Apr 13 11:22:10 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:11 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.615s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:11 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f 1073741824" returned: 0 in 0.800s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:11 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:11 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:11 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5" returned: 0 in 0.751s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:11 devstack sudo[87156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5
Apr 13 11:22:11 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:11 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.552s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38feed9-bda9-40ba-9c4b-1dbcb94b7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df2db3c-7d30-466e-86d3-a2be83176a0f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c33f105-7205-46ec-9a1e-a7910737082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Volume volume-6df2db3c-7d30-466e-86d3-a2be83176a0f (6df2db3c-7d30-466e-86d3-a2be83176a0f): created successfully
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c33f105-7205-46ec-9a1e-a7910737082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Flow 'volume_create_manager' (fa5254d0-1f64-4d69-8f06-13262bc50ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:11 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1bcef75d-9520-4b75-be2e-01033788542a tempest-VolumesDeleteCascade-1356668038 None] Created volume successfully.
Apr 13 11:22:12 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-72d30930-d83d-4873-87d9-934c233e29b5" returned: 0 in 0.527s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-quobyte-72d30930-d83d-4873-87d9-934c233e29b5" released by "delete_volume" :: held 1.321s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.quota [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Created reservations ['473e572e-dbad-4697-a6d8-b4c525f4fcbb', 'aa3d7552-2670-497a-872a-0b920b68ff82', 'e5edd040-afe5-4e58-b338-227b214118da', '12e33da7-42f4-452a-a8a8-786b9688524c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:12 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:12 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "cinder-b899381c-2323-4248-809b-374347d95694-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-b899381c-2323-4248-809b-374347d95694-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "cinder-quobyte-b899381c-2323-4248-809b-374347d95694" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-quobyte-b899381c-2323-4248-809b-374347d95694" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67558b-3cd2-469e-a99b-f01abec7f38c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:12 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694
Apr 13 11:22:12 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Creating offline snapshot 57b4effd-961b-48a3-a909-1540c8950703 of volume 6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cdf3e9-cfb3-46c6-bf65-062925b9926a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:12 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.608s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.manager [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:12 devstack cinder-volume[82099]: INFO cinder.volume.manager [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Deleted volume successfully.
Apr 13 11:22:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [req-ee47b1ec-aaf1-4b99-8fda-7e421dca4e4d req-091cb030-5a43-42a1-b269-b90f2a86f046 tempest-VolumesSnapshotsTestJSON-2099379479 None] Lock "cinder-72d30930-d83d-4873-87d9-934c233e29b5-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:12 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:12 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:13 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694" returned: 0 in 0.717s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:13 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.561s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:13 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694
Apr 13 11:22:13 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:13 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 1G
Apr 13 11:22:13 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:13 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b899381c-2323-4248-809b-374347d95694" returned: 0 in 0.573s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-quobyte-b899381c-2323-4248-809b-374347d95694" released by "delete_volume" :: held 1.322s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Created reservations ['00c076d8-9fe5-4997-9fb5-0e2cbf1479a6', 'c6e444fb-de22-42f1-88eb-7e7f1adaa1fa', '9270675a-8141-4842-a912-428d63e62a50', '7b8ad653-47f5-47e4-a38c-d857a2b534cf'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:13 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 1G" returned: 0 in 0.677s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df2db3c-7d30-466e-86d3-a2be83176a0f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:14 devstack sudo[87183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:14 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:14 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df2db3c-7d30-466e-86d3-a2be83176a0f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703
Apr 13 11:22:14 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:14 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.495s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Deleted volume successfully.
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-916f4965-5ebd-4132-801c-ba009c76ebd2 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-b899381c-2323-4248-809b-374347d95694-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:14 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df2db3c-7d30-466e-86d3-a2be83176a0f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703" returned: 0 in 0.685s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:14 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 is being set with open permissions: ugo+rw
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:14 devstack sudo[87225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703
Apr 13 11:22:14 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "cinder-13377afa-8826-4c35-b8ff-4fc749f3f544-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-13377afa-8826-4c35-b8ff-4fc749f3f544-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "cinder-quobyte-13377afa-8826-4c35-b8ff-4fc749f3f544" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-quobyte-13377afa-8826-4c35-b8ff-4fc749f3f544" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bf7ad8-2c1a-4388-8c22-9c0bc524716f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:14 devstack sudo[87227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544
Apr 13 11:22:14 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:15 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703" returned: 0 in 0.572s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:15 devstack sudo[87230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info
Apr 13 11:22:15 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:15 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544" returned: 0 in 0.670s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:15 devstack sudo[87236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544
Apr 13 11:22:15 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:15 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info" returned: 0 in 0.545s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:15 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info is being set with open permissions: ugo+rw
Apr 13 11:22:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:15 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info
Apr 13 11:22:15 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:16 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-13377afa-8826-4c35-b8ff-4fc749f3f544" returned: 0 in 0.514s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-quobyte-13377afa-8826-4c35-b8ff-4fc749f3f544" released by "delete_volume" :: held 1.212s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Created reservations ['846c00f6-f6f3-44d6-88e6-55ce0728e620', 'fc2f0e5d-0efa-4427-ac60-6cdff27c25f1', 'f44bfee4-09f6-4523-be8c-6da47e17aa3b', '80e74a64-9158-4730-8ebd-8456b16def68'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:16 devstack sudo[87242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:16 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:16 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.info" returned: 0 in 0.578s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.687s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8c8c5600-18cb-4b61-8fb1-4e402b505b70 tempest-VolumesDeleteCascade-1356668038 None] Create snapshot completed successfully
Apr 13 11:22:16 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Deleted volume successfully.
Apr 13 11:22:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-635eb784-4f66-447b-831a-8e3b8b91fe12 tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-13377afa-8826-4c35-b8ff-4fc749f3f544-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ef4a696d-9aa0-4339-a9f5-2417cf8024ce tempest-BackendsCapabilitiesAdminTestsJSON-1978068927 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82099) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Flow 'volume_create_manager' (e1e51d2b-7281-4a12-b1dd-9c7392220ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878d1548-4a91-43f6-bb80-5a01cdb798ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878d1548-4a91-43f6-bb80-5a01cdb798ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1987695304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf49ba1-947d-4c1b-b948-1ec42a692593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f21f76704c4884b0dbecfae23bd9ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57b4effd-961b-48a3-a909-1540c8950703,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:17Z,use_quota=True,user_id='966efa281e0a4cadb94627fa4d5dec49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaa2a62-27fa-4155-90ec-b75d9822f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaa2a62-27fa-4155-90ec-b75d9822f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb3a3e2-a06d-4dba-9dba-116a64d87c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb3a3e2-a06d-4dba-9dba-116a64d87c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8bf49ba1-947d-4c1b-b948-1ec42a692593', 'volume_name': 'volume-8bf49ba1-947d-4c1b-b948-1ec42a692593', 'volume_size': 1, 'snapshot_id': '57b4effd-961b-48a3-a909-1540c8950703'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e53063e-c133-412b-b74b-b007664f3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e53063e-c133-412b-b74b-b007664f3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebf4b19-c9ec-4aa8-a743-b0de3ced7472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Volume 8bf49ba1-947d-4c1b-b948-1ec42a692593: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8bf49ba1-947d-4c1b-b948-1ec42a692593', 'volume_size': 1, 'snapshot_id': '57b4effd-961b-48a3-a909-1540c8950703'}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "cinder-e216b199-4f3e-4e81-a31f-efa8ae12ac1c-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-57b4effd-961b-48a3-a909-1540c8950703-8bf49ba1-947d-4c1b-b948-1ec42a692593" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-e216b199-4f3e-4e81-a31f-efa8ae12ac1c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-57b4effd-961b-48a3-a909-1540c8950703-8bf49ba1-947d-4c1b-b948-1ec42a692593" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Creating volume 8bf49ba1-947d-4c1b-b948-1ec42a692593 from snapshot 57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-8bf49ba1-947d-4c1b-b948-1ec42a692593" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8bf49ba1-947d-4c1b-b948-1ec42a692593" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] snapshot: 57b4effd-961b-48a3-a909-1540c8950703, volume: 8bf49ba1-947d-4c1b-b948-1ec42a692593,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "cinder-quobyte-e216b199-4f3e-4e81-a31f-efa8ae12ac1c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c6e3e1-0b65-4339-a758-600a310ba16c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-quobyte-e216b199-4f3e-4e81-a31f-efa8ae12ac1c" acquired by "delete_volume" :: waited 0.035s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f236e-8671-4d42-92cd-c816de831833]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:17 devstack sudo[87247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703
Apr 13 11:22:17 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:17 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c
Apr 13 11:22:17 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2e21651e-9402-4778-aea7-a87dbbc900c7 tempest-BackendsCapabilitiesAdminTestsJSON-1978068927 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82099) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 11:22:17 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c" returned: 0 in 0.486s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:17 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c
Apr 13 11:22:17 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:17 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703" returned: 0 in 0.533s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df2db3c-7d30-466e-86d3-a2be83176a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[459fa08d-f355-44ad-92c8-8680c1842767]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:18 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:18 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:18 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e216b199-4f3e-4e81-a31f-efa8ae12ac1c" returned: 0 in 0.476s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-quobyte-e216b199-4f3e-4e81-a31f-efa8ae12ac1c" released by "delete_volume" :: held 0.986s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Created reservations ['7fe9066a-8e22-48d0-829d-40d1ef685c86', 'a2abe938-dc03-4cef-b0bb-ca812c43ea59', '1508690e-8f90-4cd7-ba0c-b96b98116985', '6c6c1700-1640-40a5-bfd6-75b5b23e480f'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:18 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:18 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:18 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.580s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:22:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:18 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593
Apr 13 11:22:18 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:19 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.554s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:19 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Deleted volume successfully.
Apr 13 11:22:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-4b3d4259-f2b2-41d9-a059-8a495248c33d tempest-VolumesListTestJSON-1770984360 None] Lock "cinder-e216b199-4f3e-4e81-a31f-efa8ae12ac1c-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:21 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593" returned: 0 in 2.545s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:21 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2cd67c-a74d-4a64-9c22-e1964f5a49b6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:21 devstack sudo[87280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:21 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:21 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.834s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:21 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:22:21 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Converted 1024.00 MB image at 402.26 MB/s
Apr 13 11:22:21 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 is being set with open permissions: ugo+rw
Apr 13 11:22:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:21 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593
Apr 13 11:22:21 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:22 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593" returned: 0 in 0.569s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8bf49ba1-947d-4c1b-b948-1ec42a692593" released by "_copy_volume_from_snapshot" :: held 5.140s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-57b4effd-961b-48a3-a909-1540c8950703-8bf49ba1-947d-4c1b-b948-1ec42a692593" released by "_create_volume_from_snapshot" :: held 5.167s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.189s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=192,cinder:DELETE=21,cinder:SELECT=145,cinder:INSERT=49 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=154,cinder:UPDATE=204,cinder:INSERT=49,cinder:DELETE=14 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebf4b19-c9ec-4aa8-a743-b0de3ced7472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf49ba1-947d-4c1b-b948-1ec42a692593', 'volume_size': 1, 'snapshot_id': '57b4effd-961b-48a3-a909-1540c8950703'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48502c5-05fb-4d59-a1d0-cb48adbfd1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:22 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Volume volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 (8bf49ba1-947d-4c1b-b948-1ec42a692593): created successfully
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48502c5-05fb-4d59-a1d0-cb48adbfd1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Flow 'volume_create_manager' (e1e51d2b-7281-4a12-b1dd-9c7392220ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:22 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d617a072-5a41-44db-9fa7-ce7783e8ead8 tempest-VolumesDeleteCascade-1356668038 None] Created volume successfully.
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Flow 'volume_create_manager' (3f22a19f-836f-4932-8be9-8c438dea570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e154366a-4932-4744-bd2c-ef4c6bc35780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e154366a-4932-4744-bd2c-ef4c6bc35780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1666101227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168604f1-bae7-407c-b9d1-a6b316eaacb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5a8f0ced0b4ed78a87491770a40219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:23Z,use_quota=True,user_id='400c22ea24084ef384f7b95ef995144d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfbbdc3-d16e-4f3a-8be5-318d4b75a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfbbdc3-d16e-4f3a-8be5-318d4b75a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b2fe35-03f5-42dc-b293-9db18ca609db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b2fe35-03f5-42dc-b293-9db18ca609db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168604f1-bae7-407c-b9d1-a6b316eaacb6', 'volume_name': 'volume-168604f1-bae7-407c-b9d1-a6b316eaacb6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb76e33-e2db-46ad-ba64-ccc318e3bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb76e33-e2db-46ad-ba64-ccc318e3bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b19011-8295-42f3-b01e-5fd203643a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:22 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Volume 168604f1-bae7-407c-b9d1-a6b316eaacb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168604f1-bae7-407c-b9d1-a6b316eaacb6', 'volume_size': 1}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1666101227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168604f1-bae7-407c-b9d1-a6b316eaacb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5a8f0ced0b4ed78a87491770a40219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:23Z,use_quota=True,user_id='400c22ea24084ef384f7b95ef995144d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Creating volume 168604f1-bae7-407c-b9d1-a6b316eaacb6 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:22 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-6df2db3c-7d30-466e-86d3-a2be83176a0f-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:22 devstack sudo[87289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 1073741824
Apr 13 11:22:22 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-6df2db3c-7d30-466e-86d3-a2be83176a0f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Performing cascade delete. {{(pid=82099) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-57b4effd-961b-48a3-a909-1540c8950703-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-57b4effd-961b-48a3-a909-1540c8950703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-6df2db3c-7d30-466e-86d3-a2be83176a0f" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-6df2db3c-7d30-466e-86d3-a2be83176a0f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-57b4effd-961b-48a3-a909-1540c8950703" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-57b4effd-961b-48a3-a909-1540c8950703" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Deleting offline snapshot 57b4effd-961b-48a3-a909-1540c8950703 of volume 6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] snapshot_file for this snap is: volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a1075b-51b5-4816-9196-8a483c86619b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:23 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703
Apr 13 11:22:23 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bd73353a-edec-45eb-a246-7d7c437fdf47 tempest-GroupsV320Test-509493618 None] Group tempest-GroupsV320Test-Group-721956853: creating
Apr 13 11:22:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bd73353a-edec-45eb-a246-7d7c437fdf47 tempest-GroupsV320Test-509493618 None] Group tempest-GroupsV320Test-Group-721956853: created successfully
Apr 13 11:22:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bd73353a-edec-45eb-a246-7d7c437fdf47 tempest-GroupsV320Test-509493618 None] Create group completed successfully.
Apr 13 11:22:23 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 1073741824" returned: 0 in 0.523s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:23 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6
Apr 13 11:22:23 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:23 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703" returned: 0 in 0.531s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df2db3c-7d30-466e-86d3-a2be83176a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3db81b-8a77-4333-9e19-74f4c2a291a0]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:23 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:23 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:23 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b19011-8295-42f3-b01e-5fd203643a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168604f1-bae7-407c-b9d1-a6b316eaacb6', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef500ca-7514-4422-93ff-90c7d6310567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:23 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Volume volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 (168604f1-bae7-407c-b9d1-a6b316eaacb6): created successfully
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef500ca-7514-4422-93ff-90c7d6310567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Flow 'volume_create_manager' (3f22a19f-836f-4932-8be9-8c438dea570d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5db023bd-2046-46c3-a497-2b5a6cb71689 tempest-VolumesNegativeTest-1547825444 None] Created volume successfully.
Apr 13 11:22:24 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.544s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:24 devstack sudo[87307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703
Apr 13 11:22:24 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Created reservations ['860830a9-dd65-4fc5-a07b-469d1ed85245'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:24 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:24 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:24 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703" returned: 0 in 0.564s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:24 devstack sudo[87314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703
Apr 13 11:22:24 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:25 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.524s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:25 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9f2138cc-722c-4edb-98f6-890bbb046ec2 tempest-GroupsV320Test-509493618 None] Delete group completed successfully.
Apr 13 11:22:25 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f.57b4effd-961b-48a3-a909-1540c8950703" returned: 0 in 0.512s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-57b4effd-961b-48a3-a909-1540c8950703" released by "_delete_snapshot" :: held 2.209s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-6df2db3c-7d30-466e-86d3-a2be83176a0f" released by "delete_snapshot" :: held 2.226s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Created reservations ['7d751888-af99-4e46-aef8-7ffe3b446ed2', 'b978331d-6085-4632-a5c6-3809e97651b5', 'd5e37ded-a176-493b-a855-8efb4fa1afba', 'e5ab7ca9-7a2b-4c95-83cd-884c72b9c8b3'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:25 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Delete snapshot completed successfully.
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-57b4effd-961b-48a3-a909-1540c8950703-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Snapshots deleted, issuing volume delete {{(pid=82099) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-6df2db3c-7d30-466e-86d3-a2be83176a0f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-6df2db3c-7d30-466e-86d3-a2be83176a0f" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fad436-b0f4-49e9-b43d-228b159be96a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:25 devstack sudo[87318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:25 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:25 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.604s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:25 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f
Apr 13 11:22:25 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:26 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6df2db3c-7d30-466e-86d3-a2be83176a0f" returned: 0 in 0.527s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-6df2db3c-7d30-466e-86d3-a2be83176a0f" released by "delete_volume" :: held 1.170s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Created reservations ['ca53a9a8-fafc-4ff0-9524-a5b11d4f98e0', '3fca8ef7-200e-4356-a99e-902a0584294b', 'b0a9197e-5ce6-4cc0-92f9-86c98e76a5e6', '22eac5f4-7a02-4c80-88ef-5e99d441ca90'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:26 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:26 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:27 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.495s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Deleted volume successfully.
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7e358750-c87d-4257-9e27-a8a4ff731347 tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-6df2db3c-7d30-466e-86d3-a2be83176a0f-delete_volume" released by "delete_volume" :: held 4.207s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-8bf49ba1-947d-4c1b-b948-1ec42a692593-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-8bf49ba1-947d-4c1b-b948-1ec42a692593-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "cinder-quobyte-8bf49ba1-947d-4c1b-b948-1ec42a692593" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8bf49ba1-947d-4c1b-b948-1ec42a692593" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb408315-3565-47f3-abfc-879d04917b5f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:27 devstack sudo[87333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593
Apr 13 11:22:27 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:27 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593" returned: 0 in 0.562s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:27 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593
Apr 13 11:22:27 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:28 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8bf49ba1-947d-4c1b-b948-1ec42a692593" returned: 0 in 0.455s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-quobyte-8bf49ba1-947d-4c1b-b948-1ec42a692593" released by "delete_volume" :: held 1.051s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Created reservations ['045f8c09-d825-4645-afb5-d66de8e42572', 'b75f3641-078b-41ad-9cd1-c9cc21205d4a', 'c5ad8571-db77-4851-865d-ac3226c80281', 'e4f3e2b0-5d78-494a-9669-457117e22040'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:28 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:28 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:28 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:28 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Deleted volume successfully.
Apr 13 11:22:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f24b0217-6df2-48e5-b61f-c0606aa3492b tempest-VolumesDeleteCascade-1356668038 None] Lock "cinder-8bf49ba1-947d-4c1b-b948-1ec42a692593-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Flow 'volume_create_manager' (96a6153d-1b94-4238-8bfa-dbb58978ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39876fb-b2e8-4691-b6d2-4963a5611262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39876fb-b2e8-4691-b6d2-4963a5611262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1830990666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179928c8-8c87-4f3d-84d3-68e52dea0262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9fb9456af748c89e0620eeeb0268fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:33Z,use_quota=True,user_id='c92f89409ed045e28954f2092f40328f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1597fb6-dc8b-44aa-818a-d09a64af3eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1597fb6-dc8b-44aa-818a-d09a64af3eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c55207-3465-421f-9dc7-e3ce01dc1c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c55207-3465-421f-9dc7-e3ce01dc1c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179928c8-8c87-4f3d-84d3-68e52dea0262', 'volume_name': 'volume-179928c8-8c87-4f3d-84d3-68e52dea0262', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8505627b-53f4-43e4-afda-ec781aed08e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8505627b-53f4-43e4-afda-ec781aed08e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366bf9e3-6c24-4525-b993-720bd2f7d11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:33 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Volume 179928c8-8c87-4f3d-84d3-68e52dea0262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179928c8-8c87-4f3d-84d3-68e52dea0262', 'volume_size': 1}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1830990666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179928c8-8c87-4f3d-84d3-68e52dea0262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9fb9456af748c89e0620eeeb0268fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:33Z,use_quota=True,user_id='c92f89409ed045e28954f2092f40328f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Creating volume 179928c8-8c87-4f3d-84d3-68e52dea0262 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:33 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:33 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262 1073741824
Apr 13 11:22:33 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:33 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262 1073741824" returned: 0 in 0.570s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:33 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262
Apr 13 11:22:33 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:34 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366bf9e3-6c24-4525-b993-720bd2f7d11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179928c8-8c87-4f3d-84d3-68e52dea0262', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6041cb7a-4197-458f-b857-9dba1d6dc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Volume volume-179928c8-8c87-4f3d-84d3-68e52dea0262 (179928c8-8c87-4f3d-84d3-68e52dea0262): created successfully
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6041cb7a-4197-458f-b857-9dba1d6dc93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Flow 'volume_create_manager' (96a6153d-1b94-4238-8bfa-dbb58978ad55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-98f5763a-fd32-499f-9178-e8686bc0aa70 tempest-VolumesTransfersV357Test-1375561610 None] Created volume successfully.
Apr 13 11:22:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-807807f9-723a-4b83-8e51-998f8200667a tempest-VolumesTransfersV357Test-1730486776 None] Transfer volume completed successfully.
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Flow 'volume_create_manager' (2cbd2488-c9ab-4001-811d-77a0a6466fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e313c39e-8822-4db4-869c-3e37d522a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e313c39e-8822-4db4-869c-3e37d522a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-705134919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0c3fce-b518-4e10-84cd-0e141e9ec01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e858d360569491daf07d11f07e9fa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:36Z,use_quota=True,user_id='0721b8da339842a3bf644743d8b6d5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4f8085-ea24-44ee-ad7a-77d317f4e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4f8085-ea24-44ee-ad7a-77d317f4e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56e68ce-a641-4439-affc-af281d209d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56e68ce-a641-4439-affc-af281d209d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0c3fce-b518-4e10-84cd-0e141e9ec01e', 'volume_name': 'volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33c1f41-5a7e-4fbb-9e44-a42d0d2e030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33c1f41-5a7e-4fbb-9e44-a42d0d2e030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb505a08-bda1-4349-be8b-45693d29f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Volume 7c0c3fce-b518-4e10-84cd-0e141e9ec01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e', 'volume_size': 1}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-705134919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0c3fce-b518-4e10-84cd-0e141e9ec01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e858d360569491daf07d11f07e9fa25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:36Z,use_quota=True,user_id='0721b8da339842a3bf644743d8b6d5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Creating volume 7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:36 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:36 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e 1073741824
Apr 13 11:22:36 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Acquiring lock "cinder-179928c8-8c87-4f3d-84d3-68e52dea0262-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-179928c8-8c87-4f3d-84d3-68e52dea0262-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Acquiring lock "cinder-quobyte-179928c8-8c87-4f3d-84d3-68e52dea0262" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-quobyte-179928c8-8c87-4f3d-84d3-68e52dea0262" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c68115-db33-4d8a-ac7f-e77e4521a6be]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:36 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262
Apr 13 11:22:36 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:37 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e 1073741824" returned: 0 in 0.814s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:37 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e
Apr 13 11:22:37 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:37 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262" returned: 0 in 0.886s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:37 devstack sudo[87412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262
Apr 13 11:22:37 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:38 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" returned: 0 in 0.699s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb505a08-bda1-4349-be8b-45693d29f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb54c168-ea03-4a4b-8799-100f85df3d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:38 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Volume volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e (7c0c3fce-b518-4e10-84cd-0e141e9ec01e): created successfully
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb54c168-ea03-4a4b-8799-100f85df3d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Flow 'volume_create_manager' (2cbd2488-c9ab-4001-811d-77a0a6466fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0209079c-a3e3-4407-8937-7da61b0acc0f tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Created volume successfully.
Apr 13 11:22:38 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-179928c8-8c87-4f3d-84d3-68e52dea0262" returned: 0 in 0.591s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-quobyte-179928c8-8c87-4f3d-84d3-68e52dea0262" released by "delete_volume" :: held 1.506s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Created reservations ['f25b333f-ed8d-4b9c-8580-6af9e96c4051', '82ed2c6e-134d-4db3-9eb7-a603b20e9bf0', 'eb209c00-7f59-46e6-8fbd-e9bcfc62ad83', '488e4268-4b94-4c79-95b0-56a90d363fb8'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:38 devstack sudo[87417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:38 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Creating offline snapshot b077bab3-50b0-4800-b1d3-89361825487e of volume 7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe987df-5e94-4498-9951-22b47e1330ea]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:39 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.522s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:39 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Deleted volume successfully.
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-978876bf-8d8f-41b1-9c4c-833fc0218b74 tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-179928c8-8c87-4f3d-84d3-68e52dea0262-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:39 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e
Apr 13 11:22:39 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Flow 'volume_create_manager' (a841ad8c-4e30-4fc3-83b5-63fccbc27a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77e3fb3-f55f-4d20-996e-b60f893fbee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77e3fb3-f55f-4d20-996e-b60f893fbee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1188531126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d51fe1-233b-463a-8b77-1c10e40cb5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9fb9456af748c89e0620eeeb0268fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:39Z,use_quota=True,user_id='c92f89409ed045e28954f2092f40328f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c32789-c660-4217-9828-1dced861dc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c32789-c660-4217-9828-1dced861dc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e8a325-6ab3-4fee-97f7-1b8427ece876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e8a325-6ab3-4fee-97f7-1b8427ece876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d51fe1-233b-463a-8b77-1c10e40cb5ed', 'volume_name': 'volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af15c7c4-7607-4f32-87ab-f12aed4f62b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af15c7c4-7607-4f32-87ab-f12aed4f62b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fc1794-82b5-46d5-a15d-c092bead66db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:39 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Volume a1d51fe1-233b-463a-8b77-1c10e40cb5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed', 'volume_size': 1}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:39 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" returned: 0 in 0.620s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:39 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e 1G
Apr 13 11:22:39 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:40 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e 1G" returned: 0 in 0.679s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:40 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e
Apr 13 11:22:40 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:40 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e" returned: 0 in 0.570s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:40 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e is being set with open permissions: ugo+rw
Apr 13 11:22:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:40 devstack sudo[87436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e
Apr 13 11:22:40 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:41 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e" returned: 0 in 0.464s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:41 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info
Apr 13 11:22:41 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:41 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info" returned: 0 in 0.487s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:41 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info is being set with open permissions: ugo+rw
Apr 13 11:22:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:41 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info
Apr 13 11:22:41 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:42 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.info" returned: 0 in 0.449s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.341s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.780s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1188531126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d51fe1-233b-463a-8b77-1c10e40cb5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9fb9456af748c89e0620eeeb0268fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:39Z,use_quota=True,user_id='c92f89409ed045e28954f2092f40328f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Creating volume a1d51fe1-233b-463a-8b77-1c10e40cb5ed {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:42 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:42 devstack sudo[87471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed 1073741824
Apr 13 11:22:42 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:42 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2c9657ca-d0c9-424f-8d51-b9e025dd1720 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Create snapshot completed successfully
Apr 13 11:22:42 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed 1073741824" returned: 0 in 0.546s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:42 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed
Apr 13 11:22:42 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:43 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed" returned: 0 in 0.526s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fc1794-82b5-46d5-a15d-c092bead66db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f79d0b-d698-4969-8b5c-6df950195d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "cinder-b077bab3-50b0-4800-b1d3-89361825487e-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:43 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Volume volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed (a1d51fe1-233b-463a-8b77-1c10e40cb5ed): created successfully
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f79d0b-d698-4969-8b5c-6df950195d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Flow 'volume_create_manager' (a841ad8c-4e30-4fc3-83b5-63fccbc27a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-b077bab3-50b0-4800-b1d3-89361825487e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "cinder-quobyte-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:43 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-693a7274-15f3-4b58-86e0-b74a79f6960a tempest-VolumesTransfersV357Test-1375561610 None] Created volume successfully.
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-quobyte-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "cinder-quobyte-b077bab3-50b0-4800-b1d3-89361825487e" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-quobyte-b077bab3-50b0-4800-b1d3-89361825487e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Deleting offline snapshot b077bab3-50b0-4800-b1d3-89361825487e of volume 7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] snapshot_file for this snap is: volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e408aa45-39d3-4d8c-994b-b1d40fbb258c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:43 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e
Apr 13 11:22:43 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Acquiring lock "cinder-a1d51fe1-233b-463a-8b77-1c10e40cb5ed-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-a1d51fe1-233b-463a-8b77-1c10e40cb5ed-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Acquiring lock "cinder-quobyte-a1d51fe1-233b-463a-8b77-1c10e40cb5ed" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-quobyte-a1d51fe1-233b-463a-8b77-1c10e40cb5ed" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1c0ca-3417-4e80-a338-cf7194a74f43]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:44 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed
Apr 13 11:22:44 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:44 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e" returned: 0 in 0.570s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[50637b27-94bf-4f55-b3e8-24635079633c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:44 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e
Apr 13 11:22:44 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:44 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed" returned: 0 in 0.538s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:44 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed
Apr 13 11:22:44 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:44 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" returned: 0 in 0.516s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:44 devstack sudo[87499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e
Apr 13 11:22:44 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:44 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a1d51fe1-233b-463a-8b77-1c10e40cb5ed" returned: 0 in 0.408s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-quobyte-a1d51fe1-233b-463a-8b77-1c10e40cb5ed" released by "delete_volume" :: held 0.968s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Created reservations ['72cfd934-2b38-479c-b322-9bb29303e462', 'd95431e4-239d-4234-8493-a3d70a0907b3', 'b117e09d-9cb4-4b23-b272-fb9cbe41af71', '21ed33af-29d6-47e4-bbf3-c83c70b023eb'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:45 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:45 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:45 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e" returned: 0 in 0.537s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:45 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e
Apr 13 11:22:45 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:45 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.499s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:45 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Deleted volume successfully.
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f7187153-7bdc-4571-b06b-6a0c156fc7ae tempest-VolumesTransfersV357Test-1685849271 None] Lock "cinder-a1d51fe1-233b-463a-8b77-1c10e40cb5ed-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:45 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e.b077bab3-50b0-4800-b1d3-89361825487e" returned: 0 in 0.493s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-quobyte-b077bab3-50b0-4800-b1d3-89361825487e" released by "_delete_snapshot" :: held 2.176s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-quobyte-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" released by "delete_snapshot" :: held 2.188s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Created reservations ['8e030a39-e6bd-4421-88ae-cbe541bebcbc', '711df4d7-b536-4988-96ea-e1442446e0c9', '9e410f03-4626-4dfb-8e5d-f21b146d7a43', '25426e49-ac0c-4d6b-909a-2704d5daf3ce'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:45 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Delete snapshot completed successfully.
Apr 13 11:22:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f9dd9a18-bbc1-484d-83f5-1be1ecde906b tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-b077bab3-50b0-4800-b1d3-89361825487e-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "cinder-7c0c3fce-b518-4e10-84cd-0e141e9ec01e-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-7c0c3fce-b518-4e10-84cd-0e141e9ec01e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "cinder-quobyte-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-quobyte-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7f32d-d1d5-4c3b-9df4-30e4a0e7aa77]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:46 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e
Apr 13 11:22:46 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:47 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" returned: 0 in 0.556s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:47 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e
Apr 13 11:22:47 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:47 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-quobyte-7c0c3fce-b518-4e10-84cd-0e141e9ec01e" released by "delete_volume" :: held 1.105s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Created reservations ['5d2c506f-66b6-49ff-95d1-857215cad195', 'f1635a05-805a-4c1e-90c7-1d88997efedc', 'a6c9de6b-aaac-4cac-9b4d-bdfdb2a93bfb', '3123c311-9a28-4d48-9e45-4ef1185c9bb5'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:47 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:47 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:48 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.499s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:48 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Deleted volume successfully.
Apr 13 11:22:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-31a84bae-bcc4-47a2-b578-4095f0594e40 tempest-VolumeSnapshotQuotasNegativeTestJSON-118863242 None] Lock "cinder-7c0c3fce-b518-4e10-84cd-0e141e9ec01e-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Acquiring lock "cinder-168604f1-bae7-407c-b9d1-a6b316eaacb6-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Lock "cinder-168604f1-bae7-407c-b9d1-a6b316eaacb6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Acquiring lock "cinder-quobyte-168604f1-bae7-407c-b9d1-a6b316eaacb6" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Lock "cinder-quobyte-168604f1-bae7-407c-b9d1-a6b316eaacb6" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc9ff8-fb05-449f-8723-e343638b4fac]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:53 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6
Apr 13 11:22:53 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:53 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6" returned: 0 in 0.593s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:53 devstack sudo[87532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6
Apr 13 11:22:53 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:54 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-168604f1-bae7-407c-b9d1-a6b316eaacb6" returned: 0 in 0.423s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Lock "cinder-quobyte-168604f1-bae7-407c-b9d1-a6b316eaacb6" released by "delete_volume" :: held 1.044s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Created reservations ['edc0bdb8-2b82-41b8-807c-232d5b58591a', '089436d6-cb75-40c9-8498-df7ff92c92ed', '434baa8f-8ff7-4d14-8278-0d14d56ed47b', 'e4250968-cffd-45ce-a397-14631da5efe7'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:54 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:22:54 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:54 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.435s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:22:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Deleted volume successfully.
Apr 13 11:22:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e856836e-1a1e-4344-b333-584c47a46ec8 tempest-VolumesNegativeTest-1547825444 None] Lock "cinder-168604f1-bae7-407c-b9d1-a6b316eaacb6-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Flow 'volume_create_manager' (5aba68ab-7af3-47e8-83cb-b5f6405a05a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f08118-7a6d-48ab-bbce-5ae1be6faa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f08118-7a6d-48ab-bbce-5ae1be6faa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471775120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf964ae-68d0-40a4-8534-c6b76eee3f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5833fc8dddb4271841455bba0bffbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:57Z,use_quota=True,user_id='a5ff28d1d480424a82b57b0a665fa591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ee3ac6-3d9f-49ff-98a2-982348d525bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ee3ac6-3d9f-49ff-98a2-982348d525bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc66bda-c228-4bde-b5ef-8952cd58af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc66bda-c228-4bde-b5ef-8952cd58af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf964ae-68d0-40a4-8534-c6b76eee3f6b', 'volume_name': 'volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dd7b02-8867-4209-91e1-5745e5bf0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dd7b02-8867-4209-91e1-5745e5bf0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b429fffe-b627-42ea-8707-29f206403c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Volume 0cf964ae-68d0-40a4-8534-c6b76eee3f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b', 'volume_size': 1}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-471775120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf964ae-68d0-40a4-8534-c6b76eee3f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5833fc8dddb4271841455bba0bffbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:57Z,use_quota=True,user_id='a5ff28d1d480424a82b57b0a665fa591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Creating volume 0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:57 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:57 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b 1073741824
Apr 13 11:22:57 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Flow 'volume_create_manager' (2d5204c0-b47d-4da4-9438-c0bb154bc311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd5fd1b-2fa3-469d-b5db-85518c138b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd5fd1b-2fa3-469d-b5db-85518c138b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-648114430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3309e9e2-f62d-4006-b448-7b930f465b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e053f686ef44f4ab0a6bb3d9c0082e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:57Z,use_quota=True,user_id='94dd8ce49a754e5e87f14ca4b091a3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3dba37-ca16-4fc1-b1c1-a5861aa3900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3dba37-ca16-4fc1-b1c1-a5861aa3900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982f4c3b-e6b7-40c7-93c8-dcc31a9218fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982f4c3b-e6b7-40c7-93c8-dcc31a9218fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3309e9e2-f62d-4006-b448-7b930f465b84', 'volume_name': 'volume-3309e9e2-f62d-4006-b448-7b930f465b84', 'volume_size': 2}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e191bf9-2475-4b97-8f6e-2bc7991dd98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e191bf9-2475-4b97-8f6e-2bc7991dd98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2c985b-5418-4bbc-8d4e-07c10dccb9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:57 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Volume 3309e9e2-f62d-4006-b448-7b930f465b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3309e9e2-f62d-4006-b448-7b930f465b84', 'volume_size': 2}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:57 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b 1073741824" returned: 0 in 0.601s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:57 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:22:57 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:58 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.555s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-648114430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3309e9e2-f62d-4006-b448-7b930f465b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e053f686ef44f4ab0a6bb3d9c0082e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:22:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:22:57Z,use_quota=True,user_id='94dd8ce49a754e5e87f14ca4b091a3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Creating volume 3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:22:58 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 2147483648 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b429fffe-b627-42ea-8707-29f206403c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acdd043-608f-4ff1-899f-2b461f7c1582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:58 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Volume volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b (0cf964ae-68d0-40a4-8534-c6b76eee3f6b): created successfully
Apr 13 11:22:58 devstack sudo[87547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 2147483648
Apr 13 11:22:58 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acdd043-608f-4ff1-899f-2b461f7c1582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Flow 'volume_create_manager' (5aba68ab-7af3-47e8-83cb-b5f6405a05a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-318f14e7-2b58-46c2-ab0d-6c2bdf6b9a3e tempest-VolumesActionsTest-1381144454 None] Created volume successfully.
Apr 13 11:22:59 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 2147483648" returned: 0 in 0.617s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:22:59 devstack sudo[87552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84
Apr 13 11:22:59 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:22:59 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84" returned: 0 in 0.462s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2c985b-5418-4bbc-8d4e-07c10dccb9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3309e9e2-f62d-4006-b448-7b930f465b84', 'volume_size': 2}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b593b-329a-4a88-a41e-175ca5361bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:22:59 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Volume volume-3309e9e2-f62d-4006-b448-7b930f465b84 (3309e9e2-f62d-4006-b448-7b930f465b84): created successfully
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b593b-329a-4a88-a41e-175ca5361bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:22:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Flow 'volume_create_manager' (2d5204c0-b47d-4da4-9438-c0bb154bc311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:22:59 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5f8462ae-039c-4a54-adbe-b1d96e11eeda tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Created volume successfully.
Apr 13 11:23:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Creating offline snapshot 2bd5b365-6d7d-41f7-8e73-083d01120b9e of volume 3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:23:00 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21dcb6-17c8-4a73-927c-c5a41fb7226a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:00 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84
Apr 13 11:23:00 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:01 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84" returned: 0 in 0.580s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e 2G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:01 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e 2G
Apr 13 11:23:01 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:01 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e 2G" returned: 0 in 0.580s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3309e9e2-f62d-4006-b448-7b930f465b84 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:01 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3309e9e2-f62d-4006-b448-7b930f465b84 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e
Apr 13 11:23:01 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:02 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3309e9e2-f62d-4006-b448-7b930f465b84 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e" returned: 0 in 0.577s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:02 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e is being set with open permissions: ugo+rw
Apr 13 11:23:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:02 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e
Apr 13 11:23:02 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:02 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e" returned: 0 in 0.522s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:03 devstack sudo[87579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info
Apr 13 11:23:03 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:03 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info" returned: 0 in 0.487s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:03 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info is being set with open permissions: ugo+rw
Apr 13 11:23:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:03 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info
Apr 13 11:23:03 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:03 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.info" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.297s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2698bbfe-24c5-4d4f-895d-e9bc11344175 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Create snapshot completed successfully
Apr 13 11:23:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "cinder-2bd5b365-6d7d-41f7-8e73-083d01120b9e-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-2bd5b365-6d7d-41f7-8e73-083d01120b9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "cinder-quobyte-3309e9e2-f62d-4006-b448-7b930f465b84" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-quobyte-3309e9e2-f62d-4006-b448-7b930f465b84" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "cinder-quobyte-2bd5b365-6d7d-41f7-8e73-083d01120b9e" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-quobyte-2bd5b365-6d7d-41f7-8e73-083d01120b9e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Deleting offline snapshot 2bd5b365-6d7d-41f7-8e73-083d01120b9e of volume 3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] snapshot_file for this snap is: volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b79da-bc41-434c-a5e1-3612899b14ba]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:05 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e
Apr 13 11:23:05 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:05 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e" returned: 0 in 0.633s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3309e9e2-f62d-4006-b448-7b930f465b84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2dcab7-d129-4561-8569-f2e9e3944a22]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:05 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84
Apr 13 11:23:05 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:06 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84" returned: 0 in 0.610s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:06 devstack sudo[87603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e
Apr 13 11:23:06 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:07 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e" returned: 0 in 0.799s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:07 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e
Apr 13 11:23:07 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:07 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84.2bd5b365-6d7d-41f7-8e73-083d01120b9e" returned: 0 in 0.587s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-quobyte-2bd5b365-6d7d-41f7-8e73-083d01120b9e" released by "_delete_snapshot" :: held 2.698s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-quobyte-3309e9e2-f62d-4006-b448-7b930f465b84" released by "delete_snapshot" :: held 2.713s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Created reservations ['e9647aec-6b3e-4090-959b-c2a72d291c76', '106f80dd-dde0-4f59-84fe-6f87662797bd', 'a8ef12b6-6ffd-4bac-9d02-c0f801991c2a', 'd8c44457-9841-4d48-98d4-f7db6a6cb029'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:07 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Delete snapshot completed successfully.
Apr 13 11:23:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-100bf0a0-42a7-4b1f-98d3-6c98d308b214 tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-2bd5b365-6d7d-41f7-8e73-083d01120b9e-delete_snapshot" released by "delete_snapshot" :: held 2.818s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "cinder-3309e9e2-f62d-4006-b448-7b930f465b84-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-3309e9e2-f62d-4006-b448-7b930f465b84-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "cinder-quobyte-3309e9e2-f62d-4006-b448-7b930f465b84" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-quobyte-3309e9e2-f62d-4006-b448-7b930f465b84" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[29100d26-910c-4cba-b63e-2c7e33521425]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:08 devstack sudo[87627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84
Apr 13 11:23:08 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:08 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84" returned: 0 in 0.564s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:08 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84
Apr 13 11:23:08 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:09 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3309e9e2-f62d-4006-b448-7b930f465b84" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-quobyte-3309e9e2-f62d-4006-b448-7b930f465b84" released by "delete_volume" :: held 1.113s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Created reservations ['147bc715-e306-4c97-82bf-f93cd6262da1', '71633a99-6e14-43af-b141-47eedacc010e', 'd82d86f1-d004-4ed2-8af3-bff374262b50', '0ffdb13e-8d60-4983-8e14-3da330490807'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:09 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:09 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:09 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.490s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Deleted volume successfully.
Apr 13 11:23:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fc96b3ba-0f4d-4ecd-b70a-7e3417e32a0a tempest-VolumesSnapshotNegativeTestJSON-267547687 None] Lock "cinder-3309e9e2-f62d-4006-b448-7b930f465b84-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:10 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:10 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:11 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.806s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (fffd0526-067a-4e67-b7d9-6baece9d0fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c26aafb-2a47-43cd-9414-8db4f74ec312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c26aafb-2a47-43cd-9414-8db4f74ec312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240090931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dd0b18-c677-459f-8c05-ba9b3d121780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:13Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4ce5a1-51b1-4ca9-94a7-b75c0348113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4ce5a1-51b1-4ca9-94a7-b75c0348113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f912354-8e8d-4b46-b562-928746993f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f912354-8e8d-4b46-b562-928746993f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1dd0b18-c677-459f-8c05-ba9b3d121780', 'volume_name': 'volume-b1dd0b18-c677-459f-8c05-ba9b3d121780', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da8743c-a255-4433-9643-d5b411e32cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da8743c-a255-4433-9643-d5b411e32cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead41530-f6ea-475b-90c8-031614b0e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:12 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Volume b1dd0b18-c677-459f-8c05-ba9b3d121780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1dd0b18-c677-459f-8c05-ba9b3d121780', 'volume_size': 1}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240090931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dd0b18-c677-459f-8c05-ba9b3d121780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:13Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Creating volume b1dd0b18-c677-459f-8c05-ba9b3d121780 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:12 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:13 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 1073741824
Apr 13 11:23:13 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (e3504e77-0231-46fd-a494-65690c1d1100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e7a322-0d41-4b4d-8a28-5afe7d13fb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e7a322-0d41-4b4d-8a28-5afe7d13fb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020435801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58feaf8-9fd6-478c-b061-f1ff9b711326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:13Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344ba7a2-e297-44b3-bd4b-22ef453e957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344ba7a2-e297-44b3-bd4b-22ef453e957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae65f74e-8274-4f90-bb2e-73f314fc18a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae65f74e-8274-4f90-bb2e-73f314fc18a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58feaf8-9fd6-478c-b061-f1ff9b711326', 'volume_name': 'volume-c58feaf8-9fd6-478c-b061-f1ff9b711326', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c4ac0d-c022-4946-8bd2-9576da78decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c4ac0d-c022-4946-8bd2-9576da78decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6019aaaa-d5e9-4c32-a5fc-879d13803deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Volume c58feaf8-9fd6-478c-b061-f1ff9b711326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58feaf8-9fd6-478c-b061-f1ff9b711326', 'volume_size': 1}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (3869a31e-b113-45b8-86fb-8ae3e93172fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527282ea-2b81-4671-9c47-d62066b6b1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527282ea-2b81-4671-9c47-d62066b6b1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1426255878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f606d4db-44d6-4e6d-8382-38c18db1d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:13Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8ef16c-232f-4b7c-9f17-e3805257317f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8ef16c-232f-4b7c-9f17-e3805257317f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31804db-e08c-4961-90f7-b5c57048339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31804db-e08c-4961-90f7-b5c57048339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f606d4db-44d6-4e6d-8382-38c18db1d832', 'volume_name': 'volume-f606d4db-44d6-4e6d-8382-38c18db1d832', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8144dea5-a688-4af3-9b17-3cb539928bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8144dea5-a688-4af3-9b17-3cb539928bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08793c6-1cda-4771-bd59-b171b607beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Volume f606d4db-44d6-4e6d-8382-38c18db1d832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f606d4db-44d6-4e6d-8382-38c18db1d832', 'volume_size': 1}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (8e43350f-f9c2-419c-bee0-0f65e69f99fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25564d97-3b0b-44c9-9c67-7ff34fabae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25564d97-3b0b-44c9-9c67-7ff34fabae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070481791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a22811-caa4-4a82-96d8-da5e42a6bb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:14Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57022a7b-2b99-413e-aba6-ebfd15c2bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57022a7b-2b99-413e-aba6-ebfd15c2bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ef35c7-c2af-49fd-976b-507a24e6d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ef35c7-c2af-49fd-976b-507a24e6d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a22811-caa4-4a82-96d8-da5e42a6bb56', 'volume_name': 'volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f4f8f8-6157-4e8a-b400-e0c72f6fdbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f4f8f8-6157-4e8a-b400-e0c72f6fdbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe49a1d8-b520-4059-a2c9-0eca73f742ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:13 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Volume f6a22811-caa4-4a82-96d8-da5e42a6bb56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56', 'volume_size': 1}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:13 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 1073741824" returned: 0 in 0.784s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:13 devstack sudo[87674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780
Apr 13 11:23:13 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:13 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (d22158f9-944a-4387-8388-529aa1e9807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6d5cf6-e03e-489c-9202-d81ea2196316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6d5cf6-e03e-489c-9202-d81ea2196316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848087115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac52d88-8608-42b9-bd0a-07f04a2069ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:14Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5cd2ae-6f63-49a1-a7e9-2a6069e06f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5cd2ae-6f63-49a1-a7e9-2a6069e06f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8b5f20-2e20-4fc2-bede-d27b41993dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8b5f20-2e20-4fc2-bede-d27b41993dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac52d88-8608-42b9-bd0a-07f04a2069ff', 'volume_name': 'volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffa6b16-7034-48a6-8000-797ff42d2134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffa6b16-7034-48a6-8000-797ff42d2134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82befc75-1b4f-4f21-b941-3fac26abe5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:14 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Volume 5ac52d88-8608-42b9-bd0a-07f04a2069ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff', 'volume_size': 1}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:14 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780" returned: 0 in 0.662s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020435801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58feaf8-9fd6-478c-b061-f1ff9b711326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:13Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Creating volume c58feaf8-9fd6-478c-b061-f1ff9b711326 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:14 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead41530-f6ea-475b-90c8-031614b0e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1dd0b18-c677-459f-8c05-ba9b3d121780', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf075f6-29f1-47aa-a8d6-2c54574fe70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:14 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 1073741824
Apr 13 11:23:14 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:14 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Volume volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 (b1dd0b18-c677-459f-8c05-ba9b3d121780): created successfully
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf075f6-29f1-47aa-a8d6-2c54574fe70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:14 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (fffd0526-067a-4e67-b7d9-6baece9d0fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-52fea15c-4b67-4922-8003-847d99309bcf tempest-CreateVolumesFromImageTest-1182516702 None] Created volume successfully.
Apr 13 11:23:15 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 1073741824" returned: 0 in 0.936s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:15 devstack sudo[87719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326
Apr 13 11:23:15 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:16 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-909205f6-2fef-453d-bc51-8a76ee22e048 tempest-VolumesActionsTest-1381144454 None] Acquiring lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" by "attach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326" returned: 0 in 0.616s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1426255878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f606d4db-44d6-4e6d-8382-38c18db1d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:13Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Creating volume f606d4db-44d6-4e6d-8382-38c18db1d832 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-909205f6-2fef-453d-bc51-8a76ee22e048 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" acquired by "attach_volume" :: waited 0.057s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6019aaaa-d5e9-4c32-a5fc-879d13803deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58feaf8-9fd6-478c-b061-f1ff9b711326', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0389f-825e-4bf4-aace-ce3ba404c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Volume volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 (c58feaf8-9fd6-478c-b061-f1ff9b711326): created successfully
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f0389f-825e-4bf4-aace-ce3ba404c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (e3504e77-0231-46fd-a494-65690c1d1100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:16 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832 1073741824
Apr 13 11:23:16 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-35880ce5-5213-4ecf-832f-722ff8e2d393 tempest-CreateVolumesFromImageTest-1182516702 None] Created volume successfully.
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-909205f6-2fef-453d-bc51-8a76ee22e048 tempest-VolumesActionsTest-1381144454 None] Attaching volume 0cf964ae-68d0-40a4-8534-c6b76eee3f6b to instance 014fb045-c593-4971-9373-ae2cc03811f1 at mountpoint /dev/vdb on host None.
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-909205f6-2fef-453d-bc51-8a76ee22e048 tempest-VolumesActionsTest-1381144454 None] Attach volume completed successfully.
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-909205f6-2fef-453d-bc51-8a76ee22e048 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" released by "attach_volume" :: held 0.134s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-53a93931-7b4e-4f43-b88f-1ef89df96199 tempest-VolumesActionsTest-1381144454 None] Acquiring lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-detach_volume" by "detach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-53a93931-7b4e-4f43-b88f-1ef89df96199 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-53a93931-7b4e-4f43-b88f-1ef89df96199 tempest-VolumesActionsTest-1381144454 None] Detaching volume 0cf964ae-68d0-40a4-8534-c6b76eee3f6b from instance 014fb045-c593-4971-9373-ae2cc03811f1.
Apr 13 11:23:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-53a93931-7b4e-4f43-b88f-1ef89df96199 tempest-VolumesActionsTest-1381144454 None] Detach volume completed successfully.
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-53a93931-7b4e-4f43-b88f-1ef89df96199 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:16 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832 1073741824" returned: 0 in 0.846s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:16 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832
Apr 13 11:23:16 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:17 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832" returned: 0 in 0.489s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.681s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070481791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a22811-caa4-4a82-96d8-da5e42a6bb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:14Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Creating volume f6a22811-caa4-4a82-96d8-da5e42a6bb56 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:17 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08793c6-1cda-4771-bd59-b171b607beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f606d4db-44d6-4e6d-8382-38c18db1d832', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd95177-ef54-49a1-a654-aa8229462654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Volume volume-f606d4db-44d6-4e6d-8382-38c18db1d832 (f606d4db-44d6-4e6d-8382-38c18db1d832): created successfully
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd95177-ef54-49a1-a654-aa8229462654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (3869a31e-b113-45b8-86fb-8ae3e93172fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:17 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3069b424-178e-4f3e-871f-77460eee0ca3 tempest-CreateVolumesFromImageTest-1182516702 None] Created volume successfully.
Apr 13 11:23:17 devstack sudo[87736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 1073741824
Apr 13 11:23:17 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:18 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 1073741824" returned: 0 in 0.583s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:18 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56
Apr 13 11:23:18 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:18 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.488s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-848087115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac52d88-8608-42b9-bd0a-07f04a2069ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f608b2e5b5cd47a88d22d6882d27936b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:14Z,use_quota=True,user_id='848f4908bdde406196fe47c69dba0349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Creating volume 5ac52d88-8608-42b9-bd0a-07f04a2069ff {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:18 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe49a1d8-b520-4059-a2c9-0eca73f742ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb59650-363e-4a56-adb7-ceef20ff2c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:18 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff 1073741824
Apr 13 11:23:18 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Volume volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 (f6a22811-caa4-4a82-96d8-da5e42a6bb56): created successfully
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb59650-363e-4a56-adb7-ceef20ff2c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (8e43350f-f9c2-419c-bee0-0f65e69f99fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1596b428-1a7d-443e-a5c6-a6bfdc0d4ad5 tempest-CreateVolumesFromImageTest-1182516702 None] Created volume successfully.
Apr 13 11:23:19 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff 1073741824" returned: 0 in 0.666s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:19 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff
Apr 13 11:23:19 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:19 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff" returned: 0 in 0.447s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82befc75-1b4f-4f21-b941-3fac26abe5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9682b4-6aba-465f-96d8-80cdca0679e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:19 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Volume volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff (5ac52d88-8608-42b9-bd0a-07f04a2069ff): created successfully
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9682b4-6aba-465f-96d8-80cdca0679e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:19 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Flow 'volume_create_manager' (d22158f9-944a-4387-8388-529aa1e9807b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e2a308fa-275e-432b-9a7f-34733fb24141 tempest-CreateVolumesFromImageTest-1182516702 None] Created volume successfully.
Apr 13 11:23:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-5ac52d88-8608-42b9-bd0a-07f04a2069ff-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-5ac52d88-8608-42b9-bd0a-07f04a2069ff-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-quobyte-5ac52d88-8608-42b9-bd0a-07f04a2069ff" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-5ac52d88-8608-42b9-bd0a-07f04a2069ff" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:20 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6613811-fc51-47ce-8690-2836ee1d5253]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:20 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff
Apr 13 11:23:20 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:21 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff" returned: 0 in 0.592s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:21 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff
Apr 13 11:23:21 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:21 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5ac52d88-8608-42b9-bd0a-07f04a2069ff" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-5ac52d88-8608-42b9-bd0a-07f04a2069ff" released by "delete_volume" :: held 1.167s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Created reservations ['1c52b57c-8b26-4df8-9095-b0c5d01dbbf9', '4044a5b6-307c-4a85-9549-d62d8b528b54', '86b0214a-8834-422d-907c-3db1af47a8b9', 'bf4681ff-66a0-4415-99d7-e5f3e6f0db08'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:21 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:21 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:22 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:22 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Deleted volume successfully.
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6eee6a9d-b7ed-44fe-af74-08f165e5fa1a tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-5ac52d88-8608-42b9-bd0a-07f04a2069ff-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-f6a22811-caa4-4a82-96d8-da5e42a6bb56-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-f6a22811-caa4-4a82-96d8-da5e42a6bb56-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=125,cinder:SELECT=100,cinder:DELETE=9,cinder:INSERT=26 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=124,cinder:DELETE=13,cinder:SELECT=99,cinder:INSERT=34 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-quobyte-f6a22811-caa4-4a82-96d8-da5e42a6bb56" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-f6a22811-caa4-4a82-96d8-da5e42a6bb56" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c10b31-4889-497c-9779-3f253154d235]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:22 devstack sudo[87803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56
Apr 13 11:23:22 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:23 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56" returned: 0 in 0.553s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:23 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56
Apr 13 11:23:23 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:24 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f6a22811-caa4-4a82-96d8-da5e42a6bb56" returned: 0 in 0.575s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-f6a22811-caa4-4a82-96d8-da5e42a6bb56" released by "delete_volume" :: held 1.161s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Created reservations ['ad8299ae-0f02-4e28-87c5-c56bed5b7e81', 'c36d331b-0c94-4955-a929-b25a99e7b914', '775eb03a-c202-49ff-83cb-c4db6cccfe83', '7d56fe2d-2ffd-4178-aa99-d8e95f0d6486'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:24 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:24 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:24 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:24 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Deleted volume successfully.
Apr 13 11:23:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d7a8e7f0-5e25-49b3-b629-cb50b30a30d4 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-f6a22811-caa4-4a82-96d8-da5e42a6bb56-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-f606d4db-44d6-4e6d-8382-38c18db1d832-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-f606d4db-44d6-4e6d-8382-38c18db1d832-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-quobyte-f606d4db-44d6-4e6d-8382-38c18db1d832" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-f606d4db-44d6-4e6d-8382-38c18db1d832" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa1261-fb3d-4a0c-a1e5-4c15f4967c95]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:25 devstack sudo[87821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832
Apr 13 11:23:25 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:25 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832" returned: 0 in 0.513s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:25 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832
Apr 13 11:23:25 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:26 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f606d4db-44d6-4e6d-8382-38c18db1d832" returned: 0 in 0.417s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-f606d4db-44d6-4e6d-8382-38c18db1d832" released by "delete_volume" :: held 0.953s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Created reservations ['b2a58e0b-a24f-47ba-9b81-0ee174f65f17', '7a0c50ac-2201-4a7c-b0a5-c5b807edc45e', '6bce7991-6e48-4459-ab98-4ba11f3579d9', '70f6c5a5-58cd-403d-bc7d-a9a8edbd6a99'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:26 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:26 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-c58feaf8-9fd6-478c-b061-f1ff9b711326-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-c58feaf8-9fd6-478c-b061-f1ff9b711326-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-quobyte-c58feaf8-9fd6-478c-b061-f1ff9b711326" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-c58feaf8-9fd6-478c-b061-f1ff9b711326" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6114d537-fea2-4972-af75-e439cdc822cb]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:26 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326
Apr 13 11:23:26 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:26 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.674s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:26 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Deleted volume successfully.
Apr 13 11:23:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1a7965b6-09ba-49bb-aee6-8194c7c3a7b6 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-f606d4db-44d6-4e6d-8382-38c18db1d832-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:27 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326" returned: 0 in 0.725s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:27 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326
Apr 13 11:23:27 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:27 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c58feaf8-9fd6-478c-b061-f1ff9b711326" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-c58feaf8-9fd6-478c-b061-f1ff9b711326" released by "delete_volume" :: held 1.262s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Created reservations ['648a474c-9a79-4d41-bc13-8123ec92f583', '6cb6235e-67fc-4725-a127-cda344369c27', 'bbcdfdf9-e80e-47f1-9368-69db046f2803', '5377a0de-0ab0-40f3-8776-458b52eb6082'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:27 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:27 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:28 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.483s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:28 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Deleted volume successfully.
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ee63bc14-55a2-417f-9908-364a146504aa tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-c58feaf8-9fd6-478c-b061-f1ff9b711326-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-b1dd0b18-c677-459f-8c05-ba9b3d121780-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-b1dd0b18-c677-459f-8c05-ba9b3d121780-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "cinder-quobyte-b1dd0b18-c677-459f-8c05-ba9b3d121780" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-b1dd0b18-c677-459f-8c05-ba9b3d121780" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf7344-c941-432e-a51b-c5c084567c0d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:28 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780
Apr 13 11:23:28 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:29 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780" returned: 0 in 0.722s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:29 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780
Apr 13 11:23:29 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:30 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b1dd0b18-c677-459f-8c05-ba9b3d121780" returned: 0 in 0.736s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-quobyte-b1dd0b18-c677-459f-8c05-ba9b3d121780" released by "delete_volume" :: held 1.497s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (9e11c9d0-dafc-4a9e-9810-67de1ac0d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbb5893-bd23-487b-aac7-215f277ce842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbb5893-bd23-487b-aac7-215f277ce842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1559492336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc16874-1a3a-404f-90a2-4e6acb40d10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:30Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a05c7b-276f-4779-a601-9f924b4609b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a05c7b-276f-4779-a601-9f924b4609b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ee1f86-c27c-4a2b-b5c6-b6d7e28c741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ee1f86-c27c-4a2b-b5c6-b6d7e28c741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc16874-1a3a-404f-90a2-4e6acb40d10d', 'volume_name': 'volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d8fdc3-5063-40f0-9b9c-09279686860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d8fdc3-5063-40f0-9b9c-09279686860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530619d0-e6c5-43df-85c5-cdbc194521b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Volume 5cc16874-1a3a-404f-90a2-4e6acb40d10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d', 'volume_size': 1}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1559492336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc16874-1a3a-404f-90a2-4e6acb40d10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:30Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Creating volume 5cc16874-1a3a-404f-90a2-4e6acb40d10d {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:30 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:30 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d 1073741824
Apr 13 11:23:30 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Created reservations ['6172caf0-b374-493c-a5d2-aa187394f120', '8b1a147d-3e21-4968-a18b-7e417348093f', '79f6f61c-8851-4e60-8b92-7d65b0dc4a13', '8cfba543-c445-4a34-9647-9131d6dec9e5'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:30 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:30 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:30 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.441s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Deleted volume successfully.
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-6c9b8072-38c8-4a4d-b0a0-e7ad09050519 tempest-CreateVolumesFromImageTest-1182516702 None] Lock "cinder-b1dd0b18-c677-459f-8c05-ba9b3d121780-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:30 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d 1073741824" returned: 0 in 0.708s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:30 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d
Apr 13 11:23:30 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:31 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d" returned: 0 in 0.454s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530619d0-e6c5-43df-85c5-cdbc194521b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7624a91b-3efd-4ea5-9368-343a0dcb1ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:31 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Volume volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d (5cc16874-1a3a-404f-90a2-4e6acb40d10d): created successfully
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7624a91b-3efd-4ea5-9368-343a0dcb1ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (9e11c9d0-dafc-4a9e-9810-67de1ac0d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:31 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c87d5bad-d08a-44b5-9fa7-c543886c9d90 tempest-VolumesActionsTest-2127337370 None] Created volume successfully.
Apr 13 11:23:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-74c2e06b-9f03-468d-b810-dab9e7a15a44 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d" by "attach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-74c2e06b-9f03-468d-b810-dab9e7a15a44 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d" acquired by "attach_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:32 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-74c2e06b-9f03-468d-b810-dab9e7a15a44 tempest-VolumesActionsTest-2127337370 None] Attaching volume 5cc16874-1a3a-404f-90a2-4e6acb40d10d to instance 72243861-d594-498d-b187-41f7e2a7cb65 at mountpoint /dev/vdb on host None.
Apr 13 11:23:32 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-74c2e06b-9f03-468d-b810-dab9e7a15a44 tempest-VolumesActionsTest-2127337370 None] Attach volume completed successfully.
Apr 13 11:23:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-74c2e06b-9f03-468d-b810-dab9e7a15a44 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d" released by "attach_volume" :: held 0.069s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:33 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9045e71d-472e-434f-8c7f-0e3b4d36b627 tempest-VolumesActionsTest-765078909 None] Terminate volume connection completed successfully.
Apr 13 11:23:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9045e71d-472e-434f-8c7f-0e3b4d36b627 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-detach_volume" by "detach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9045e71d-472e-434f-8c7f-0e3b4d36b627 tempest-VolumesActionsTest-765078909 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:33 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9045e71d-472e-434f-8c7f-0e3b4d36b627 tempest-VolumesActionsTest-765078909 None] Detaching volume 5cc16874-1a3a-404f-90a2-4e6acb40d10d from instance 72243861-d594-498d-b187-41f7e2a7cb65.
Apr 13 11:23:33 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9045e71d-472e-434f-8c7f-0e3b4d36b627 tempest-VolumesActionsTest-765078909 None] Detach volume completed successfully.
Apr 13 11:23:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9045e71d-472e-434f-8c7f-0e3b4d36b627 tempest-VolumesActionsTest-765078909 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-56cc04c7-0887-4848-81eb-26916af477d2 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-detach_volume" by "detach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-56cc04c7-0887-4848-81eb-26916af477d2 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-56cc04c7-0887-4848-81eb-26916af477d2 tempest-VolumesActionsTest-2127337370 None] Volume detach called, but volume not attached.
Apr 13 11:23:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-56cc04c7-0887-4848-81eb-26916af477d2 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-detach_volume" released by "detach_volume" :: held 0.009s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "cinder-quobyte-5cc16874-1a3a-404f-90a2-4e6acb40d10d" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-quobyte-5cc16874-1a3a-404f-90a2-4e6acb40d10d" acquired by "delete_volume" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad7b31b-b7f5-4459-8249-b4812b06b226]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:35 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d
Apr 13 11:23:35 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:35 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d" returned: 0 in 0.608s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:36 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d
Apr 13 11:23:36 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:36 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-5cc16874-1a3a-404f-90a2-4e6acb40d10d" returned: 0 in 0.509s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-quobyte-5cc16874-1a3a-404f-90a2-4e6acb40d10d" released by "delete_volume" :: held 1.227s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Created reservations ['9ed724c3-3dfa-4407-897a-34e1f5dbd10c', '3457ab9d-1e19-4aef-a813-fa5ad57e71bb', 'bf93bc4d-5e05-4ed8-9e06-c1eefbe72f26', '059224a9-a1d9-4d57-95f7-b11e00a4dc18'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:36 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:36 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c2635c7c-97cc-4b9e-9f50-b984782e59bc tempest-VolumesActionsTest-1381144454 None] Acquiring lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" by "attach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c2635c7c-97cc-4b9e-9f50-b984782e59bc tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" acquired by "attach_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c2635c7c-97cc-4b9e-9f50-b984782e59bc tempest-VolumesActionsTest-1381144454 None] Attaching volume 0cf964ae-68d0-40a4-8534-c6b76eee3f6b to instance b3edcb7f-8885-4871-8a23-868811f86721 at mountpoint /dev/vdb on host None.
Apr 13 11:23:37 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c2635c7c-97cc-4b9e-9f50-b984782e59bc tempest-VolumesActionsTest-1381144454 None] Attach volume completed successfully.
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c2635c7c-97cc-4b9e-9f50-b984782e59bc tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" released by "attach_volume" :: held 0.066s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.542s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Deleted volume successfully.
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-025d7682-1f80-47b9-8f82-52e1a53f6e58 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-5cc16874-1a3a-404f-90a2-4e6acb40d10d-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-803872bc-0b8d-4ce1-82b9-e1af9e3030ff tempest-VolumesActionsTest-1381144454 None] Acquiring lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-detach_volume" by "detach_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-803872bc-0b8d-4ce1-82b9-e1af9e3030ff tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-803872bc-0b8d-4ce1-82b9-e1af9e3030ff tempest-VolumesActionsTest-1381144454 None] Detaching volume 0cf964ae-68d0-40a4-8534-c6b76eee3f6b from instance b3edcb7f-8885-4871-8a23-868811f86721.
Apr 13 11:23:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-803872bc-0b8d-4ce1-82b9-e1af9e3030ff tempest-VolumesActionsTest-1381144454 None] Detach volume completed successfully.
Apr 13 11:23:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-803872bc-0b8d-4ce1-82b9-e1af9e3030ff tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (c49947f4-8829-4f10-9c12-4e417d2128b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f601aae-15ba-422c-b5c3-0b206fd22c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f601aae-15ba-422c-b5c3-0b206fd22c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-965560711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34aa442-0bb2-48e2-b7ef-9909dacde80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:44Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f89b6e9-afe6-4ff0-9588-0154f5f9d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f89b6e9-afe6-4ff0-9588-0154f5f9d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb01da7d-b5df-4d09-87db-46bdfd5777a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb01da7d-b5df-4d09-87db-46bdfd5777a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34aa442-0bb2-48e2-b7ef-9909dacde80e', 'volume_name': 'volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd321acf-e249-4a21-b8c2-5058d6f5f7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd321acf-e249-4a21-b8c2-5058d6f5f7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2e0972-7ba3-4bd7-8715-ad7f9948cd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:43 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Volume c34aa442-0bb2-48e2-b7ef-9909dacde80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e', 'volume_size': 1}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-965560711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34aa442-0bb2-48e2-b7ef-9909dacde80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:44Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Creating volume c34aa442-0bb2-48e2-b7ef-9909dacde80e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:43 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:43 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e 1073741824
Apr 13 11:23:43 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:44 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e 1073741824" returned: 0 in 0.519s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:44 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e
Apr 13 11:23:44 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:44 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e" returned: 0 in 0.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2e0972-7ba3-4bd7-8715-ad7f9948cd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696aa6c2-1bd6-4f29-98ef-6edb2520d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:44 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Volume volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e (c34aa442-0bb2-48e2-b7ef-9909dacde80e): created successfully
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696aa6c2-1bd6-4f29-98ef-6edb2520d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (c49947f4-8829-4f10-9c12-4e417d2128b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ae9725b1-4da5-4e11-a02f-61feaefdfefa tempest-VolumesActionsTest-2127337370 None] Created volume successfully.
Apr 13 11:23:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-c34aa442-0bb2-48e2-b7ef-9909dacde80e-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Lock "cinder-c34aa442-0bb2-48e2-b7ef-9909dacde80e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-quobyte-c34aa442-0bb2-48e2-b7ef-9909dacde80e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-c34aa442-0bb2-48e2-b7ef-9909dacde80e" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0c996-a047-4a40-96ff-dbe01afd465a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:46 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e
Apr 13 11:23:46 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:46 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e" returned: 0 in 0.569s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca90609-2759-4d8b-86e9-ea854911d79e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:46 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e
Apr 13 11:23:46 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:46 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:23:46 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:47 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c34aa442-0bb2-48e2-b7ef-9909dacde80e" returned: 0 in 0.438s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-c34aa442-0bb2-48e2-b7ef-9909dacde80e" released by "delete_volume" :: held 1.034s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Created reservations ['e51dfc01-2fdb-4653-b26e-6aa3506c280b', '6cc40d8c-a481-4c7b-ac76-977225ef67e4', '1c0cf07e-21b2-4a5f-870c-1b3a52cccb2c', '9fdfa12e-b790-4e03-997f-7af65958f327'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:47 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.538s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4100a-2c7c-48b9-91b2-3a34815827d1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:47 devstack sudo[88027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:23:47 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:47 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:23:47 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:47 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:23:47 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Deleted volume successfully.
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f0834175-b954-4ab0-a5f6-583c45678708 tempest-VolumesActionsTest-765078909 None] Lock "cinder-c34aa442-0bb2-48e2-b7ef-9909dacde80e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:23:47 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.503s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.3e7b1ef1-b252-4e35-89be-b7f8748e1ebdwy81a1zh.img {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:47 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.3e7b1ef1-b252-4e35-89be-b7f8748e1ebdwy81a1zh.img
Apr 13 11:23:47 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (15dc2c40-4083-4372-a874-279b29be88a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec55f4eb-f0b0-484c-8a8f-e0b1b2790e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec55f4eb-f0b0-484c-8a8f-e0b1b2790e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740543637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8cb1a6-3cfb-4881-b939-3378f71a8613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:49Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb8169c-493e-41df-9d9d-93188e081e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb8169c-493e-41df-9d9d-93188e081e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c879fbb4-c5f1-4948-8085-b02b4e76b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c879fbb4-c5f1-4948-8085-b02b4e76b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8cb1a6-3cfb-4881-b939-3378f71a8613', 'volume_name': 'volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f246c11-d71e-46ac-95dd-a6b03b9a978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f246c11-d71e-46ac-95dd-a6b03b9a978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c00a74-7958-4793-88de-290512d245d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:23:49 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Volume aa8cb1a6-3cfb-4881-b939-3378f71a8613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613', 'volume_size': 1}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:49 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.3e7b1ef1-b252-4e35-89be-b7f8748e1ebdwy81a1zh.img" returned: 0 in 2.083s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d44dc84-1b30-4750-b351-629a3d129857]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:23:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:49 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:23:49 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:50 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 13 11:23:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.627s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:23:50 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.3e7b1ef1-b252-4e35-89be-b7f8748e1ebdwy81a1zh.img {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:23:50 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Converted 1024.00 MB image at 491.34 MB/s
Apr 13 11:23:50 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] 3e7b1ef1-b252-4e35-89be-b7f8748e1ebd was raw, no need to convert to raw {{(pid=82099) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.346s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Uploaded volume to glance image-id: 3e7b1ef1-b252-4e35-89be-b7f8748e1ebd. {{(pid=82099) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.493s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740543637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8cb1a6-3cfb-4881-b939-3378f71a8613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:23:49Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Creating volume aa8cb1a6-3cfb-4881-b939-3378f71a8613 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:23:59 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:23:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:23:59 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 1073741824
Apr 13 11:23:59 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:23:59 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-dea9611d-ff9a-40ac-9923-af276dabd468 tempest-VolumesActionsTest-1381144454 None] Copy volume to image completed successfully.
Apr 13 11:24:00 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 1073741824" returned: 0 in 0.486s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:00 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613
Apr 13 11:24:00 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:00 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613" returned: 0 in 0.411s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c00a74-7958-4793-88de-290512d245d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce68d7c-db53-41b5-b6da-0d760cf97efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:00 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Volume volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 (aa8cb1a6-3cfb-4881-b939-3378f71a8613): created successfully
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce68d7c-db53-41b5-b6da-0d760cf97efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (15dc2c40-4083-4372-a874-279b29be88a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:00 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-cd3c8664-bc0c-4254-8fca-f054cf788d0f tempest-VolumesActionsTest-2127337370 None] Created volume successfully.
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5bc7c-8a3f-4917-9781-d4efc159554f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:01 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:24:01 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-aa8cb1a6-3cfb-4881-b939-3378f71a8613-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Lock "cinder-aa8cb1a6-3cfb-4881-b939-3378f71a8613-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-quobyte-aa8cb1a6-3cfb-4881-b939-3378f71a8613" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-aa8cb1a6-3cfb-4881-b939-3378f71a8613" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb564c-54b7-4781-aca1-dc7da9d2bdbe]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:01 devstack sudo[88069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613
Apr 13 11:24:01 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:02 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.552s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed70c62-8528-4d89-a735-d10d97f0c8cd]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:02 devstack sudo[88074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:24:02 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:02 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:02 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613
Apr 13 11:24:02 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:02 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.483s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:02 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img
Apr 13 11:24:02 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:02 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-aa8cb1a6-3cfb-4881-b939-3378f71a8613" returned: 0 in 0.429s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-aa8cb1a6-3cfb-4881-b939-3378f71a8613" released by "delete_volume" :: held 0.956s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Created reservations ['ee8b8f47-1778-40f8-a20a-94b4a66e3452', 'c74990d0-a00d-4aaf-8d39-e8895c6a8d15', '81545414-5eef-4fb9-b18c-02e3c1951bdc', '4d9b0470-b6d7-4e5f-85bb-22d41b05dd38'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:02 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:02 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:04 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.176s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Deleted volume successfully.
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (4b17c210-ba37-4458-8b78-fe952eafca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d866151-a325-459f-8729-05d933ed6754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d866151-a325-459f-8729-05d933ed6754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-947659792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aeb8ac8-3440-467a-b342-40d59528139a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:04Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9f09a5-56ca-4021-9ab2-fe76d3f45c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9f09a5-56ca-4021-9ab2-fe76d3f45c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a98bf14-8b2f-4460-9c4f-82fe0f09d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a98bf14-8b2f-4460-9c4f-82fe0f09d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aeb8ac8-3440-467a-b342-40d59528139a', 'volume_name': 'volume-9aeb8ac8-3440-467a-b342-40d59528139a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ce1ce2-79d9-4dd9-bc8f-0d8724c9d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ce1ce2-79d9-4dd9-bc8f-0d8724c9d0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cc0c97-25b0-4aa0-9a77-fb4d7fb82112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:04 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Volume 9aeb8ac8-3440-467a-b342-40d59528139a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aeb8ac8-3440-467a-b342-40d59528139a', 'volume_size': 1}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2155cbf0-3a4d-4144-89f2-d41799932837 tempest-VolumesActionsTest-765078909 None] Lock "cinder-aa8cb1a6-3cfb-4881-b939-3378f71a8613-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:04 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img" returned: 0 in 2.333s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de0cdca-9b67-4bf4-ab44-cca52a9288c3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:04 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:24:04 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:05 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.608s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:05 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:24:05 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Converted 1024.00 MB image at 438.68 MB/s
Apr 13 11:24:05 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] cfb6ab04-049b-43fb-bb4d-b767fcb8d579 was raw, converting to qcow2 {{(pid=82099) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 13 11:24:05 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad936396-f495-4461-a3d4-9bc89ed5f81e]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:05 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img
Apr 13 11:24:05 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:06 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img" returned: 0 in 0.490s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:06 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img
Apr 13 11:24:06 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:06 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img" returned: 1 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:06 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v
Apr 13 11:24:06 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:06 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v" returned: 0 in 0.404s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Image conversion details: src /opt/stack/data/cinder/conversion/0cf964ae-68d0-40a4-8534-c6b76eee3f6b.temp_image.cfb6ab04-049b-43fb-bb4d-b767fcb8d579f7_si_tf.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:24:06 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c7527-a167-406c-a33d-6fcf5438ec88]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:07 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v
Apr 13 11:24:07 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:07 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9j42yo_v" returned: 0 in 0.473s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.636s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Uploaded volume to glance image-id: cfb6ab04-049b-43fb-bb4d-b767fcb8d579. {{(pid=82099) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.977s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-947659792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aeb8ac8-3440-467a-b342-40d59528139a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:04Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Creating volume 9aeb8ac8-3440-467a-b342-40d59528139a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:08 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:08 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a 1073741824
Apr 13 11:24:08 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-acc79d68-8b08-4be8-8597-8f79ad15ab7b tempest-VolumesActionsTest-1381144454 None] Copy volume to image completed successfully.
Apr 13 11:24:08 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a 1073741824" returned: 0 in 0.484s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:08 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a
Apr 13 11:24:08 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:09 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a" returned: 0 in 0.411s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cc0c97-25b0-4aa0-9a77-fb4d7fb82112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aeb8ac8-3440-467a-b342-40d59528139a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293ebbf7-aacd-4a87-98c0-c2ac42f9d370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:09 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Volume volume-9aeb8ac8-3440-467a-b342-40d59528139a (9aeb8ac8-3440-467a-b342-40d59528139a): created successfully
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293ebbf7-aacd-4a87-98c0-c2ac42f9d370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (4b17c210-ba37-4458-8b78-fe952eafca9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-989e27b4-bb9e-4436-b941-b4e7339a58c5 tempest-VolumesActionsTest-2127337370 None] Created volume successfully.
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Acquiring lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Acquiring lock "cinder-quobyte-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-quobyte-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[73501676-d26c-4f6f-9fd7-de6088f976d2]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:09 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:24:09 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-9aeb8ac8-3440-467a-b342-40d59528139a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Lock "cinder-9aeb8ac8-3440-467a-b342-40d59528139a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-quobyte-9aeb8ac8-3440-467a-b342-40d59528139a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-9aeb8ac8-3440-467a-b342-40d59528139a" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a024a3-54fe-40f7-98dd-ba109279dfd1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:09 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a
Apr 13 11:24:09 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:09 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:09 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b
Apr 13 11:24:09 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:09 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a" returned: 0 in 0.445s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:09 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a
Apr 13 11:24:09 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:10 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" returned: 0 in 0.427s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-quobyte-0cf964ae-68d0-40a4-8534-c6b76eee3f6b" released by "delete_volume" :: held 0.930s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Created reservations ['ab1ef2b5-e34e-439f-834f-ccd6aae581bf', '3ceb1406-12e2-4cd3-98d8-34786ef62179', '44d9ea0a-08f1-4282-8152-0fe0f3d6a08f', '3e7ff9b6-b8d4-426f-a213-24620b89dddf'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:10 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:10 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:10 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9aeb8ac8-3440-467a-b342-40d59528139a" returned: 0 in 0.400s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-9aeb8ac8-3440-467a-b342-40d59528139a" released by "delete_volume" :: held 0.868s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Created reservations ['5caa4b61-4712-409c-9fd7-c0f63baf0370', 'd5d4e732-a31d-448c-94f3-ea7dfa384c95', '5448f2d7-01b7-4607-a800-f6b8c22a9d86', 'f378aec4-a9d8-4161-865e-b9e1dcd6d634'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:10 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:10 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:10 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.420s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:10 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Deleted volume successfully.
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-864bdae6-fe8f-451b-b4a3-bfe3e59ce9b5 tempest-VolumesActionsTest-1381144454 None] Lock "cinder-0cf964ae-68d0-40a4-8534-c6b76eee3f6b-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:10 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:10 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (a750fd01-d7ec-4d94-bbc4-2d7dc0bbba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4d4213-0d9f-4d5b-9565-0fc87790c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4d4213-0d9f-4d5b-9565-0fc87790c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884375852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e04ed3-362f-4a6f-8cd6-adf966cee96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:11Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372d41e9-0616-407a-b798-162d625ee7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372d41e9-0616-407a-b798-162d625ee7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf05e3e9-6197-4e11-84a8-8611da1e1694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf05e3e9-6197-4e11-84a8-8611da1e1694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e04ed3-362f-4a6f-8cd6-adf966cee96b', 'volume_name': 'volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4655f0f-1c32-4eb8-b469-2d10ca051764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4655f0f-1c32-4eb8-b469-2d10ca051764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4110cf01-fc53-4c6d-89b2-558916014fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:10 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Volume 70e04ed3-362f-4a6f-8cd6-adf966cee96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b', 'volume_size': 1}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-884375852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e04ed3-362f-4a6f-8cd6-adf966cee96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:11Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Creating volume 70e04ed3-362f-4a6f-8cd6-adf966cee96b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:10 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:10 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.545s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:10 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Deleted volume successfully.
Apr 13 11:24:10 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b 1073741824
Apr 13 11:24:10 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5e26ab49-01d9-41da-a05c-97f4e0644f41 tempest-VolumesActionsTest-765078909 None] Lock "cinder-9aeb8ac8-3440-467a-b342-40d59528139a-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:11 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:11 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b 1073741824" returned: 0 in 0.488s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:11 devstack sudo[88177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b
Apr 13 11:24:11 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:11 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b" returned: 0 in 0.453s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4110cf01-fc53-4c6d-89b2-558916014fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c9e7e7-a554-4d82-ac67-c15a3469ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Volume volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b (70e04ed3-362f-4a6f-8cd6-adf966cee96b): created successfully
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c9e7e7-a554-4d82-ac67-c15a3469ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (a750fd01-d7ec-4d94-bbc4-2d7dc0bbba04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:11 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-16befb02-f391-4ce0-9621-8b8826a2b966 tempest-VolumesActionsTest-2127337370 None] Created volume successfully.
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-70e04ed3-362f-4a6f-8cd6-adf966cee96b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Lock "cinder-70e04ed3-362f-4a6f-8cd6-adf966cee96b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Acquiring lock "cinder-quobyte-70e04ed3-362f-4a6f-8cd6-adf966cee96b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-70e04ed3-362f-4a6f-8cd6-adf966cee96b" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[514b9b5a-2c0a-4a5b-a553-7141a465b158]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:13 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b
Apr 13 11:24:13 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:13 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b" returned: 0 in 0.575s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:13 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b
Apr 13 11:24:13 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:14 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-70e04ed3-362f-4a6f-8cd6-adf966cee96b" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Lock "cinder-quobyte-70e04ed3-362f-4a6f-8cd6-adf966cee96b" released by "delete_volume" :: held 1.131s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Created reservations ['32a554f3-2bcf-4a65-9c67-8b9a7a2605ee', '9e1b5fd5-fe55-44b5-888e-7b1e4836febe', 'f7e248f3-d093-45f9-947d-ec94e0e9de2d', 'f9714886-7786-483a-a87b-9c5fc2fd13ed'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:14 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:14 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:14 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.443s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:14 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Deleted volume successfully.
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-583cd65e-da12-462d-9772-1b63360e8fe9 tempest-VolumesActionsTest-765078909 None] Lock "cinder-70e04ed3-362f-4a6f-8cd6-adf966cee96b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:14 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Flow 'volume_create_manager' (5310ba4d-2932-4041-bfb6-c39ba113ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe5f552-d3d7-45d0-8b6b-7e808260e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe5f552-d3d7-45d0-8b6b-7e808260e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-349776943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e888e61-c85c-4758-86e0-e998718fa101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebd6284572e481996943262de733b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:15Z,use_quota=True,user_id='c143a6cfe3ca4a6c8a8ca300afea9da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c73a82-3766-4157-9266-31a0a4baef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c73a82-3766-4157-9266-31a0a4baef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2232e8f-1f9b-4e89-8268-b67e60736b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2232e8f-1f9b-4e89-8268-b67e60736b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e888e61-c85c-4758-86e0-e998718fa101', 'volume_name': 'volume-2e888e61-c85c-4758-86e0-e998718fa101', 'volume_size': 2}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef4f677-7cec-488b-b849-a39603da8346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef4f677-7cec-488b-b849-a39603da8346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8df8e1f-4140-419a-9340-326d89fdb1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Volume 2e888e61-c85c-4758-86e0-e998718fa101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e888e61-c85c-4758-86e0-e998718fa101', 'volume_size': 2}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-349776943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e888e61-c85c-4758-86e0-e998718fa101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebd6284572e481996943262de733b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:15Z,use_quota=True,user_id='c143a6cfe3ca4a6c8a8ca300afea9da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Creating volume 2e888e61-c85c-4758-86e0-e998718fa101 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:15 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101 2147483648 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:15 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101 2147483648
Apr 13 11:24:15 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (2f2a3ed1-cf7c-46dc-86a2-bba0e6050bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a156cc-0b95-4427-bf8d-aa4ef0c9efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a156cc-0b95-4427-bf8d-aa4ef0c9efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564033700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:15Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3551151b-33ed-4777-ac35-7b6ee578816d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3551151b-33ed-4777-ac35-7b6ee578816d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d5c080-0458-4532-a396-795bc7e27f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d5c080-0458-4532-a396-795bc7e27f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f', 'volume_name': 'volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48d8f2b-c724-4dac-ab9f-120d49f3505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48d8f2b-c724-4dac-ab9f-120d49f3505f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513c04d2-98be-4c9e-a7a5-dde8bc974dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Volume a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f', 'volume_size': 1}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:15 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101 2147483648" returned: 0 in 0.572s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:15 devstack sudo[88232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101
Apr 13 11:24:15 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:16 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101" returned: 0 in 0.425s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564033700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f81e3774f4f4381b26096466227b23e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:15Z,use_quota=True,user_id='5f987a310220496ba46d90a22115ee97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Creating volume a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:16 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8df8e1f-4140-419a-9340-326d89fdb1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e888e61-c85c-4758-86e0-e998718fa101', 'volume_size': 2}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88924daf-5687-433f-b835-b3336dc505f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:16 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f 1073741824
Apr 13 11:24:16 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:16 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Volume volume-2e888e61-c85c-4758-86e0-e998718fa101 (2e888e61-c85c-4758-86e0-e998718fa101): created successfully
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88924daf-5687-433f-b835-b3336dc505f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Flow 'volume_create_manager' (5310ba4d-2932-4041-bfb6-c39ba113ab98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e1f43e8b-3297-40a5-ad26-efb7ae118a67 tempest-VolumesCloneNegativeTest-401245706 None] Created volume successfully.
Apr 13 11:24:16 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f 1073741824" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:16 devstack sudo[88240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f
Apr 13 11:24:16 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:17 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f" returned: 0 in 0.430s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513c04d2-98be-4c9e-a7a5-dde8bc974dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec9f65d-991a-4a09-a63c-16416b081d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Volume volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f (a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f): created successfully
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec9f65d-991a-4a09-a63c-16416b081d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Flow 'volume_create_manager' (2f2a3ed1-cf7c-46dc-86a2-bba0e6050bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:17 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c24d713a-b25f-4dd7-a52d-25283a6c208d tempest-VolumesActionsTest-2127337370 None] Created volume successfully.
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Acquiring lock "cinder-2e888e61-c85c-4758-86e0-e998718fa101-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Lock "cinder-2e888e61-c85c-4758-86e0-e998718fa101-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Acquiring lock "cinder-quobyte-2e888e61-c85c-4758-86e0-e998718fa101" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Lock "cinder-quobyte-2e888e61-c85c-4758-86e0-e998718fa101" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f5655-ff47-4eaa-ad81-b9cdadf357f6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:17 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101
Apr 13 11:24:17 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:17 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101" returned: 0 in 0.509s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:17 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101
Apr 13 11:24:17 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "cinder-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "cinder-quobyte-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-quobyte-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[50953316-e71a-485b-9b66-222bd17d5478]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:18 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f
Apr 13 11:24:18 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:18 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2e888e61-c85c-4758-86e0-e998718fa101" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Lock "cinder-quobyte-2e888e61-c85c-4758-86e0-e998718fa101" released by "delete_volume" :: held 1.010s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Created reservations ['70877b70-5a2e-42a3-8a0f-88ea8d69020b', 'e62c73c0-0fbe-42ce-8845-83686871daf3', '8ea3e0e3-a44a-424f-86b4-bbd710d77ce9', 'c714f8d8-9390-4d9d-b69b-7aba66c344e1'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:18 devstack sudo[88254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:18 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:18 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f" returned: 0 in 0.468s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:18 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f
Apr 13 11:24:18 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:18 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Deleted volume successfully.
Apr 13 11:24:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-ce29c07e-7396-4bd5-bd23-6cdb67e5a0b2 tempest-VolumesCloneNegativeTest-401245706 None] Lock "cinder-2e888e61-c85c-4758-86e0-e998718fa101-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:19 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f" returned: 0 in 0.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-quobyte-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f" released by "delete_volume" :: held 0.937s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Created reservations ['d39f0892-ed5b-4946-b9a1-674a69ae9a90', '26691ebb-79dc-45b8-aaf7-2ea694050d84', '7b99437f-69e9-46d7-b965-9e4c175dbc3a', 'd5ba5594-63e8-404e-8ea1-5ec8fdccf12e'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:19 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:19 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:19 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.500s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Deleted volume successfully.
Apr 13 11:24:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e0aca941-a542-48fe-8ec5-955ffba0b935 tempest-VolumesActionsTest-2127337370 None] Lock "cinder-a620fd5f-d2ff-48c2-a1e5-1bb68e401e1f-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Flow 'volume_create_manager' (9451720e-a3d5-4dc2-b2b3-572cb4f12ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0936370-2956-4329-bb61-2e1434b10a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0936370-2956-4329-bb61-2e1434b10a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-5993760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da6c524-9826-4dca-a594-f95e4b103c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eca13dabb6641418112f2cbfb77960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:21Z,use_quota=True,user_id='abc5cfb45c0145789567085b61c65aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ee1fe0-eff4-456f-af19-b9f791997d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ee1fe0-eff4-456f-af19-b9f791997d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c6351f-50b8-4f1b-8da8-99a885ca9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.image.glance [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Creating Keystone auth plugin from conf {{(pid=82099) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c6351f-50b8-4f1b-8da8-99a885ca9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1da6c524-9826-4dca-a594-f95e4b103c3c', 'volume_name': 'volume-1da6c524-9826-4dca-a594-f95e4b103c3c', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa500d864a0>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cd8361-29ef-4893-afdc-70d28b163179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cd8361-29ef-4893-afdc-70d28b163179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42a045e-c8be-410f-a8b3-ca3c8abf29ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:21 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Volume 1da6c524-9826-4dca-a594-f95e4b103c3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1da6c524-9826-4dca-a594-f95e4b103c3c', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa500d864a0>}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Trying to clone 1da6c524-9826-4dca-a594-f95e4b103c3c from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]). {{(pid=82099) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 11:24:21 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d5d2fe-07ad-4634-bad9-e915c4ca7fb2]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:22 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD
Apr 13 11:24:22 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:22 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:22 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 is fetched for user abc5cfb45c0145789567085b61c65aa0. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 11:24:22 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f4c2d2-5958-4907-afec-febdb7bfe423]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:22 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD
Apr 13 11:24:22 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:23 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-5993760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da6c524-9826-4dca-a594-f95e4b103c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eca13dabb6641418112f2cbfb77960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:21Z,use_quota=True,user_id='abc5cfb45c0145789567085b61c65aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Creating volume 1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:23 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:23 devstack sudo[88281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 1073741824
Apr 13 11:24:23 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:23 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 1073741824" returned: 0 in 0.558s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=93,cinder:INSERT=26,cinder:UPDATE=105,cinder:DELETE=9 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=96,cinder:INSERT=34,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:24:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:23 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:23 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:24 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 0 in 0.512s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Attempting download of ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 1da6c524-9826-4dca-a594-f95e4b103c3c. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[50744ddc-372b-43af-8a75-ac08919745ec]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:24 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n
Apr 13 11:24:24 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:24 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n" returned: 0 in 0.594s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:24 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n
Apr 13 11:24:24 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:25 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n" returned: 1 in 0.498s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_5d9kgl3n' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f8b8ff-e1c7-4a90-a033-7d10d24c289f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:25 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD
Apr 13 11:24:25 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:25 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] ffc1a9fa-e3a7-4577-9cbc-998b14363590 was qcow2, converting to raw {{(pid=82099) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 11:24:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:25 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:25 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:26 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 0 in 0.982s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:26 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_xnbkuxozdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:24:26 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Converted 112.00 MB image at 112.00 MB/s
Apr 13 11:24:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:26 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 1G
Apr 13 11:24:26 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:27 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 1G" returned: 0 in 0.514s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ee443-6528-4875-8c95-ca3d7a611c03]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:27 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:27 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:27 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 0 in 0.542s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:28 devstack sudo[88328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:28 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:28 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 1 in 0.519s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Downloaded image ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 1da6c524-9826-4dca-a594-f95e4b103c3c successfully. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 for user abc5cfb45c0145789567085b61c65aa0 is deleted. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Marking volume 1da6c524-9826-4dca-a594-f95e4b103c3c as bootable. {{(pid=82099) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Copying metadata from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 to 1da6c524-9826-4dca-a594-f95e4b103c3c. {{(pid=82099) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Creating volume glance metadata for volume 1da6c524-9826-4dca-a594-f95e4b103c3c backed by image ffc1a9fa-e3a7-4577-9cbc-998b14363590 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82099) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42a045e-c8be-410f-a8b3-ca3c8abf29ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da6c524-9826-4dca-a594-f95e4b103c3c', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa500d864a0>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab9b478-1239-46a1-adbd-fd6d91f66de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:28 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Volume volume-1da6c524-9826-4dca-a594-f95e4b103c3c (1da6c524-9826-4dca-a594-f95e4b103c3c): created successfully
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab9b478-1239-46a1-adbd-fd6d91f66de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Flow 'volume_create_manager' (9451720e-a3d5-4dc2-b2b3-572cb4f12ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:28 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-35c67898-f04b-4a36-9a0c-e5fa72e93013 tempest-VolumesExtendTest-230081428 None] Created volume successfully.
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d22e0-4e41-4375-94f8-fd65b574f978]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:28 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:28 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Flow 'volume_create_manager' (34610476-d45d-4e5f-865a-233d61955650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae2f1e7-4aa6-4568-8382-e5dc1d11c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae2f1e7-4aa6-4568-8382-e5dc1d11c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-228607661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a4000d-3a22-4fb2-9885-7a190be7a30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8f6e13d66241bdb0d5f046cc1410a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:29Z,use_quota=True,user_id='6b507c6ab5b44899b0238706bc217c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd78afa-8500-4cb7-8b1a-edf954c2da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd78afa-8500-4cb7-8b1a-edf954c2da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8bf9ca-6087-4647-a193-0d133e007c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8bf9ca-6087-4647-a193-0d133e007c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a4000d-3a22-4fb2-9885-7a190be7a30c', 'volume_name': 'volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b2f646-6f35-4722-881f-4712739110c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b2f646-6f35-4722-881f-4712739110c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43114287-6a35-4af8-8439-c7ba74c4c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:29 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Volume b5a4000d-3a22-4fb2-9885-7a190be7a30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c', 'volume_size': 1}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:29 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 0 in 0.493s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:29 devstack sudo[88337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:29 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:29 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 1 in 0.464s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 2G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c 2G" returned: 0 in 0.041s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.040s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.824s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-228607661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a4000d-3a22-4fb2-9885-7a190be7a30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8f6e13d66241bdb0d5f046cc1410a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:29Z,use_quota=True,user_id='6b507c6ab5b44899b0238706bc217c35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Creating volume b5a4000d-3a22-4fb2-9885-7a190be7a30c {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:29 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:29 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c 1073741824
Apr 13 11:24:29 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:29 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1a61db42-9733-42e6-84bf-bbddc7dc7d19 tempest-VolumesExtendTest-230081428 None] Extend volume completed successfully.
Apr 13 11:24:30 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c 1073741824" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:30 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c
Apr 13 11:24:30 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:30 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c" returned: 0 in 0.414s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43114287-6a35-4af8-8439-c7ba74c4c801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ec5165-c74a-419a-86f8-64012e887ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Volume volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c (b5a4000d-3a22-4fb2-9885-7a190be7a30c): created successfully
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ec5165-c74a-419a-86f8-64012e887ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Flow 'volume_create_manager' (34610476-d45d-4e5f-865a-233d61955650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f6e4c304-d7d2-43d5-912f-4457153c09fa tempest-AbsoluteLimitsTests-1663519558 None] Created volume successfully.
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-1da6c524-9826-4dca-a594-f95e4b103c3c-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-1da6c524-9826-4dca-a594-f95e4b103c3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-quobyte-1da6c524-9826-4dca-a594-f95e4b103c3c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-1da6c524-9826-4dca-a594-f95e4b103c3c" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[badaaa2a-3b32-440f-bcfb-515bc893d3c7]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Acquiring lock "cinder-b5a4000d-3a22-4fb2-9885-7a190be7a30c-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Lock "cinder-b5a4000d-3a22-4fb2-9885-7a190be7a30c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:31 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:31 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Acquiring lock "cinder-quobyte-b5a4000d-3a22-4fb2-9885-7a190be7a30c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Lock "cinder-quobyte-b5a4000d-3a22-4fb2-9885-7a190be7a30c" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8712bf-644f-4e60-bb6a-08f2cf0e993d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:31 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c
Apr 13 11:24:31 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:31 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 0 in 0.513s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:31 devstack sudo[88362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:31 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:31 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c" returned: 0 in 0.521s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:31 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c
Apr 13 11:24:31 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:32 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 1 in 0.499s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:32 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c
Apr 13 11:24:32 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:32 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b5a4000d-3a22-4fb2-9885-7a190be7a30c" returned: 0 in 0.411s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Lock "cinder-quobyte-b5a4000d-3a22-4fb2-9885-7a190be7a30c" released by "delete_volume" :: held 0.954s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Created reservations ['567025ce-a710-4c97-9477-e4426e9206ba', 'ed8d0cf8-5427-42f2-9448-0dbe1e2feab7', '8ec2f6ef-011b-4955-a129-8a4a3b0f7174', 'fbc94261-bcf3-4d06-b852-b485bd16d351'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:32 devstack sudo[88372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:32 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:32 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1da6c524-9826-4dca-a594-f95e4b103c3c" returned: 0 in 0.447s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-1da6c524-9826-4dca-a594-f95e4b103c3c" released by "delete_volume" :: held 1.507s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Created reservations ['369a040d-37fb-4672-ad3d-5e6439c70c66', '55c91dd0-1dc9-4525-b48f-e8cf4d4bd968', '2b2fa755-1141-42f4-93eb-7f450b62a7d5', 'adffaa11-700b-4e66-ac2a-0aeaa93ea976'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:32 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:32 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:32 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.542s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:32 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Deleted volume successfully.
Apr 13 11:24:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-aeb2ff1d-4cfe-43a9-9f5d-1153d094e238 tempest-AbsoluteLimitsTests-1663519558 None] Lock "cinder-b5a4000d-3a22-4fb2-9885-7a190be7a30c-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:33 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.536s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:33 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Deleted volume successfully.
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c435519d-2719-4171-b122-1e03715cd5c1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-1da6c524-9826-4dca-a594-f95e4b103c3c-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Flow 'volume_create_manager' (e7b8c127-7b64-497c-bf1d-ec21add0e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e75b8b-ebb8-4c95-9402-67119467f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e75b8b-ebb8-4c95-9402-67119467f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1070926304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f4350c-25c8-4147-9325-cbd5f66ce583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eca13dabb6641418112f2cbfb77960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:34Z,use_quota=True,user_id='abc5cfb45c0145789567085b61c65aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bc5997-d407-4d2d-a680-5c8ec2689e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bc5997-d407-4d2d-a680-5c8ec2689e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cb28e3-376c-490f-a329-014ed67e83a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cb28e3-376c-490f-a329-014ed67e83a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f4350c-25c8-4147-9325-cbd5f66ce583', 'volume_name': 'volume-66f4350c-25c8-4147-9325-cbd5f66ce583', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16c3ce-4c29-4c58-a80f-e7291fc7ff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16c3ce-4c29-4c58-a80f-e7291fc7ff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f87efc4-e028-4c75-8c99-051528d5fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:33 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Volume 66f4350c-25c8-4147-9325-cbd5f66ce583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f4350c-25c8-4147-9325-cbd5f66ce583', 'volume_size': 1}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1070926304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f4350c-25c8-4147-9325-cbd5f66ce583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eca13dabb6641418112f2cbfb77960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:34Z,use_quota=True,user_id='abc5cfb45c0145789567085b61c65aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Creating volume 66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:33 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:33 devstack sudo[88379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 1073741824
Apr 13 11:24:33 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:34 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 1073741824" returned: 0 in 0.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:34 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583
Apr 13 11:24:34 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:34 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583" returned: 0 in 0.490s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f87efc4-e028-4c75-8c99-051528d5fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f4350c-25c8-4147-9325-cbd5f66ce583', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d114e221-49b2-44cc-aea6-5ba8f1e7a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Volume volume-66f4350c-25c8-4147-9325-cbd5f66ce583 (66f4350c-25c8-4147-9325-cbd5f66ce583): created successfully
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d114e221-49b2-44cc-aea6-5ba8f1e7a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Flow 'volume_create_manager' (e7b8c127-7b64-497c-bf1d-ec21add0e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c8f1b23f-00c4-4536-af56-2ebde93e7f99 tempest-VolumesExtendTest-230081428 None] Created volume successfully.
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (d9ddea1b-c7bc-46c5-bbe6-3a0b3b22473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2b9184-04d1-4937-a10f-f861e60946ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2b9184-04d1-4937-a10f-f861e60946ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-40491619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a244f8-87eb-4f15-81c7-e818421ba65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:35Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e8c4d-6e98-4a56-9953-bce184636653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e8c4d-6e98-4a56-9953-bce184636653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62334f69-c9cb-41e7-bb34-9b15899b2b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62334f69-c9cb-41e7-bb34-9b15899b2b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a244f8-87eb-4f15-81c7-e818421ba65c', 'volume_name': 'volume-58a244f8-87eb-4f15-81c7-e818421ba65c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c95772-bd07-4e28-a93c-0140932399a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c95772-bd07-4e28-a93c-0140932399a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b31b0-ed9d-4eba-8d3c-221e801e52fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:35 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume 58a244f8-87eb-4f15-81c7-e818421ba65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a244f8-87eb-4f15-81c7-e818421ba65c', 'volume_size': 1}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-40491619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a244f8-87eb-4f15-81c7-e818421ba65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:35Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Creating volume 58a244f8-87eb-4f15-81c7-e818421ba65c {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:35 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:35 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c 1073741824
Apr 13 11:24:35 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:35 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c 1073741824" returned: 0 in 0.486s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:35 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c
Apr 13 11:24:35 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:36 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.066s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0b31b0-ed9d-4eba-8d3c-221e801e52fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a244f8-87eb-4f15-81c7-e818421ba65c', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14890492-0d8d-40e0-8029-4b2f5e0c0a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Creating offline snapshot 84818c31-ce0b-45a2-9ee3-bc57c8ac091a of volume 66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:24:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume volume-58a244f8-87eb-4f15-81c7-e818421ba65c (58a244f8-87eb-4f15-81c7-e818421ba65c): created successfully
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14890492-0d8d-40e0-8029-4b2f5e0c0a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (d9ddea1b-c7bc-46c5-bbe6-3a0b3b22473c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[484fb362-fe92-4fcb-ac21-c40dd93a698f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-dc4cf184-c7b2-4b70-9998-a593fb28ba89 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created volume successfully.
Apr 13 11:24:36 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583
Apr 13 11:24:36 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:36 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583" returned: 0 in 0.507s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:36 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a 1G
Apr 13 11:24:36 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:37 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a 1G" returned: 0 in 0.570s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66f4350c-25c8-4147-9325-cbd5f66ce583 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:37 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66f4350c-25c8-4147-9325-cbd5f66ce583 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a
Apr 13 11:24:37 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (6eae79d2-5867-4689-af50-dd5fc24740fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bff535-74ea-4d64-91ff-53e3dae1a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6bff535-74ea-4d64-91ff-53e3dae1a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-380219815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea3d648-7782-4e57-a00f-c5d370690902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:37Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb92c25-c0d8-4aaa-aaa1-574038ff742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb92c25-c0d8-4aaa-aaa1-574038ff742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c819816f-af08-4bb0-af64-d337db818040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c819816f-af08-4bb0-af64-d337db818040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea3d648-7782-4e57-a00f-c5d370690902', 'volume_name': 'volume-0ea3d648-7782-4e57-a00f-c5d370690902', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c1ed2b-cf4e-4073-b3dc-0934ad008820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c1ed2b-cf4e-4073-b3dc-0934ad008820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acba7dd6-3862-418c-99a3-e35038d29a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume 0ea3d648-7782-4e57-a00f-c5d370690902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea3d648-7782-4e57-a00f-c5d370690902', 'volume_size': 1}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (1d5bf07e-dd09-446b-a1d3-ce316ee29944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23aa302-f7ac-492a-8f85-f27ab82b6d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23aa302-f7ac-492a-8f85-f27ab82b6d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870027354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf950ad-71f2-465e-8e48-e6b4e62d7ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b657919-241b-4cb9-8eda-568359ebe80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b657919-241b-4cb9-8eda-568359ebe80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff42b951-e5ec-4769-8fb8-a1e970876bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff42b951-e5ec-4769-8fb8-a1e970876bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf950ad-71f2-465e-8e48-e6b4e62d7ca4', 'volume_name': 'volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfe4b18-4bfc-4e3e-a67d-eeeef4ffe920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfe4b18-4bfc-4e3e-a67d-eeeef4ffe920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d24cb11-6eb1-4575-a1c7-31bc704a320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume bdf950ad-71f2-465e-8e48-e6b4e62d7ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4', 'volume_size': 1}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:37 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66f4350c-25c8-4147-9325-cbd5f66ce583 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a" returned: 0 in 0.586s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:37 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a is being set with open permissions: ugo+rw
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:37 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a
Apr 13 11:24:37 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (b6947f62-016d-401e-8244-9bc9800155a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a669b734-c401-49c3-b72a-d9b168556a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a669b734-c401-49c3-b72a-d9b168556a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941543049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbf53c6-4226-4c56-aaab-f23b22655baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d289334-2f80-4842-88ce-7f0d1e5010b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d289334-2f80-4842-88ce-7f0d1e5010b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1679e651-e05b-4582-b987-98eca3f8ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1679e651-e05b-4582-b987-98eca3f8ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbf53c6-4226-4c56-aaab-f23b22655baa', 'volume_name': 'volume-edbf53c6-4226-4c56-aaab-f23b22655baa', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d579a4-9ca2-4dcd-b22e-656ca0903dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d579a4-9ca2-4dcd-b22e-656ca0903dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d98780c-857f-41a3-be79-a153131a945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:37 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume edbf53c6-4226-4c56-aaab-f23b22655baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbf53c6-4226-4c56-aaab-f23b22655baa', 'volume_size': 1}
Apr 13 11:24:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (69154530-8547-4cb2-b6ac-05dc3cd9f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a55a2a-5374-48a8-99fe-b9a12e18dd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a55a2a-5374-48a8-99fe-b9a12e18dd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019110985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1d8e67-e427-4986-b7b9-191cbd41fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481ea3d5-9f9d-4ba5-b6d1-ea37739dd3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481ea3d5-9f9d-4ba5-b6d1-ea37739dd3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45108ea3-9543-446b-8bac-0cbcea9d8947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45108ea3-9543-446b-8bac-0cbcea9d8947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d1d8e67-e427-4986-b7b9-191cbd41fc6b', 'volume_name': 'volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2970389-5c5d-4d7c-bda1-ce5df9358801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2970389-5c5d-4d7c-bda1-ce5df9358801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6228309f-1d12-41d8-b4b1-8a182037927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume 4d1d8e67-e427-4986-b7b9-191cbd41fc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b', 'volume_size': 1}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (b4535f81-83b5-4404-a4df-2c6c5f5dbfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8b0ac0-3ac1-4abe-abf5-fcd7e2ca2344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8b0ac0-3ac1-4abe-abf5-fcd7e2ca2344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746322662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f98ed30-0746-4bc4-8825-b07bf3ca4355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37f2172-311b-46cf-b85b-67701a939563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37f2172-311b-46cf-b85b-67701a939563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f3afba-72ff-41f2-a935-0f7a4f7e9975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f3afba-72ff-41f2-a935-0f7a4f7e9975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f98ed30-0746-4bc4-8825-b07bf3ca4355', 'volume_name': 'volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a497e4-f363-427e-86e8-7a164ed28fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a497e4-f363-427e-86e8-7a164ed28fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6516479-3224-4308-a65e-e7b61a852f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:38 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume 7f98ed30-0746-4bc4-8825-b07bf3ca4355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355', 'volume_size': 1}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a" returned: 0 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:38 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info
Apr 13 11:24:38 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:38 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info" returned: 0 in 0.414s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:38 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info is being set with open permissions: ugo+rw
Apr 13 11:24:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:38 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info
Apr 13 11:24:38 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:39 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.info" returned: 0 in 0.424s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-380219815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea3d648-7782-4e57-a00f-c5d370690902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:37Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Creating volume 0ea3d648-7782-4e57-a00f-c5d370690902 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:39 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:39 devstack sudo[88421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902 1073741824
Apr 13 11:24:39 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:39 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-cae1c1bf-d316-419b-a94a-fb8984516894 tempest-VolumesExtendTest-230081428 None] Create snapshot completed successfully
Apr 13 11:24:39 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902 1073741824" returned: 0 in 0.504s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:39 devstack sudo[88426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902
Apr 13 11:24:39 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:40 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902" returned: 0 in 0.456s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870027354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf950ad-71f2-465e-8e48-e6b4e62d7ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Creating volume bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:40 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acba7dd6-3862-418c-99a3-e35038d29a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea3d648-7782-4e57-a00f-c5d370690902', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42338e-1085-4e05-bb9b-dd064cc06b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:40 devstack sudo[88429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 1073741824
Apr 13 11:24:40 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume volume-0ea3d648-7782-4e57-a00f-c5d370690902 (0ea3d648-7782-4e57-a00f-c5d370690902): created successfully
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df42338e-1085-4e05-bb9b-dd064cc06b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (6eae79d2-5867-4689-af50-dd5fc24740fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ecea1861-c73d-4d1e-9722-735ceb49af30 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created volume successfully.
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:40 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 1073741824" returned: 0 in 0.517s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:40 devstack sudo[88434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4
Apr 13 11:24:40 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:41 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4" returned: 0 in 0.443s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941543049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbf53c6-4226-4c56-aaab-f23b22655baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Creating volume edbf53c6-4226-4c56-aaab-f23b22655baa {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:41 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d24cb11-6eb1-4575-a1c7-31bc704a320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890b5562-a33f-4b0b-8d75-1d521db2f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:41 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa 1073741824
Apr 13 11:24:41 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:41 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 (bdf950ad-71f2-465e-8e48-e6b4e62d7ca4): created successfully
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890b5562-a33f-4b0b-8d75-1d521db2f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (1d5bf07e-dd09-446b-a1d3-ce316ee29944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:41 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-15a03298-0dec-4697-a51a-bba2998c16a9 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created volume successfully.
Apr 13 11:24:41 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa 1073741824" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:41 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa
Apr 13 11:24:41 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:42 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.075s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019110985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d1d8e67-e427-4986-b7b9-191cbd41fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Creating volume 4d1d8e67-e427-4986-b7b9-191cbd41fc6b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:42 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d98780c-857f-41a3-be79-a153131a945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbf53c6-4226-4c56-aaab-f23b22655baa', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e89950-a10e-4947-9eb2-3a16ec5a4133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:42 devstack sudo[88445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b 1073741824
Apr 13 11:24:42 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:42 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume volume-edbf53c6-4226-4c56-aaab-f23b22655baa (edbf53c6-4226-4c56-aaab-f23b22655baa): created successfully
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e89950-a10e-4947-9eb2-3a16ec5a4133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (b6947f62-016d-401e-8244-9bc9800155a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:42 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c85ae57e-dd71-4d6e-9a17-f22f9839617c tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created volume successfully.
Apr 13 11:24:42 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b 1073741824" returned: 0 in 0.528s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:42 devstack sudo[88450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b
Apr 13 11:24:42 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:43 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b" returned: 0 in 0.469s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.897s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746322662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f98ed30-0746-4bc4-8825-b07bf3ca4355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d628e8c6dd914c49ad68507ed53d6007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:38Z,use_quota=True,user_id='6ef2fc748fd84edca090826a1d9ec340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Creating volume 7f98ed30-0746-4bc4-8825-b07bf3ca4355 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:43 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6228309f-1d12-41d8-b4b1-8a182037927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fddffbb-82ca-4b0a-b370-8060be95d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:43 devstack sudo[88453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 1073741824
Apr 13 11:24:43 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:43 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b (4d1d8e67-e427-4986-b7b9-191cbd41fc6b): created successfully
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fddffbb-82ca-4b0a-b370-8060be95d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (69154530-8547-4cb2-b6ac-05dc3cd9f105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:43 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1d845af4-b71c-47f9-a889-765cf04d0144 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created volume successfully.
Apr 13 11:24:43 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 1073741824" returned: 0 in 0.535s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:43 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355
Apr 13 11:24:43 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:44 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355" returned: 0 in 0.424s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.934s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6516479-3224-4308-a65e-e7b61a852f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f8f27-931d-4988-a52c-37ff01d633f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8845bf69-2057-4947-bd4f-35f27958d419]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:44 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Volume volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 (7f98ed30-0746-4bc4-8825-b07bf3ca4355): created successfully
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f8f27-931d-4988-a52c-37ff01d633f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Flow 'volume_create_manager' (b4535f81-83b5-4404-a4df-2c6c5f5dbfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4cb9e084-39fd-417e-8852-0ba5f916b2d8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created volume successfully.
Apr 13 11:24:44 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583
Apr 13 11:24:44 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:44 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a 2G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-7f98ed30-0746-4bc4-8825-b07bf3ca4355-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a 2G" returned: 0 in 0.090s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.614s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-7f98ed30-0746-4bc4-8825-b07bf3ca4355-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-quobyte-7f98ed30-0746-4bc4-8825-b07bf3ca4355" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-7f98ed30-0746-4bc4-8825-b07bf3ca4355" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-277dfbd6-dd0f-4270-b83c-16ae3c5d2126 tempest-VolumesExtendTest-230081428 None] Extend volume completed successfully.
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[af61718e-4a27-45a1-b24e-a21f9830948e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:44 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355
Apr 13 11:24:44 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:45 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355" returned: 0 in 0.489s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:45 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355
Apr 13 11:24:45 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-84818c31-ce0b-45a2-9ee3-bc57c8ac091a-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-84818c31-ce0b-45a2-9ee3-bc57c8ac091a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-quobyte-66f4350c-25c8-4147-9325-cbd5f66ce583" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-66f4350c-25c8-4147-9325-cbd5f66ce583" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-quobyte-84818c31-ce0b-45a2-9ee3-bc57c8ac091a" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-84818c31-ce0b-45a2-9ee3-bc57c8ac091a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Deleting offline snapshot 84818c31-ce0b-45a2-9ee3-bc57c8ac091a of volume 66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] snapshot_file for this snap is: volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[27712704-3b1a-4a13-9cea-fa830734ab98]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:45 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a
Apr 13 11:24:45 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:45 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-7f98ed30-0746-4bc4-8825-b07bf3ca4355" returned: 0 in 0.460s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-7f98ed30-0746-4bc4-8825-b07bf3ca4355" released by "delete_volume" :: held 0.972s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created reservations ['09b69345-e21e-4ab9-8cf9-7ea848468f1e', '28b073f5-6d35-429b-bad9-6f9a92706adb', '24deefa5-1947-4998-993b-72df0383c172', 'c65e9d5b-e307-4ba5-a65a-77d01521ef26'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:45 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:45 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:46 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a" returned: 0 in 0.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66f4350c-25c8-4147-9325-cbd5f66ce583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f731b-977a-4ea5-a9c7-c16ad9977775]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:46 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583
Apr 13 11:24:46 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:46 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.410s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:46 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Deleted volume successfully.
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-11e12359-ca81-4ee7-8022-64f8cd32200b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-7f98ed30-0746-4bc4-8825-b07bf3ca4355-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:46 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583" returned: 0 in 0.499s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:46 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a
Apr 13 11:24:46 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-4d1d8e67-e427-4986-b7b9-191cbd41fc6b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-4d1d8e67-e427-4986-b7b9-191cbd41fc6b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-quobyte-4d1d8e67-e427-4986-b7b9-191cbd41fc6b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-4d1d8e67-e427-4986-b7b9-191cbd41fc6b" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4a70fc-1f81-43db-92d9-d55be15d5742]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:47 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b
Apr 13 11:24:47 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:47 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a" returned: 0 in 0.488s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:47 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a
Apr 13 11:24:47 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:47 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b" returned: 0 in 0.546s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:47 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b
Apr 13 11:24:47 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:47 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583.84818c31-ce0b-45a2-9ee3-bc57c8ac091a" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-84818c31-ce0b-45a2-9ee3-bc57c8ac091a" released by "_delete_snapshot" :: held 2.036s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-66f4350c-25c8-4147-9325-cbd5f66ce583" released by "delete_snapshot" :: held 2.054s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Created reservations ['df8c0f01-90a0-470b-80cd-b6f6f301ab3e', '7f6cab49-c80d-41ba-9dc3-52a04e2be357', 'fb25ab04-ac2c-463c-9e41-7f446fb116f0', 'de38476e-280f-46a2-b78d-94dd6dc79a9d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:47 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Delete snapshot completed successfully.
Apr 13 11:24:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fba293ef-9180-41b5-b0e5-6b794f6985f1 tempest-VolumesExtendTest-230081428 None] Lock "cinder-84818c31-ce0b-45a2-9ee3-bc57c8ac091a-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:48 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4d1d8e67-e427-4986-b7b9-191cbd41fc6b" returned: 0 in 0.440s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-4d1d8e67-e427-4986-b7b9-191cbd41fc6b" released by "delete_volume" :: held 1.008s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created reservations ['d57bf2dd-6f6c-40bf-83c3-c5a75b9fcd36', '5fd1da81-6297-4275-a3f7-04ec652f0bc6', '432443ea-dcec-4ce7-8991-f3a77bd36df8', '37ecbac5-9222-43da-a3f2-e5e1fd638390'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:48 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:48 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:48 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Deleted volume successfully.
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-b0b7338d-b09f-4fe6-a10a-b4f5d2895f41 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-4d1d8e67-e427-4986-b7b9-191cbd41fc6b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-66f4350c-25c8-4147-9325-cbd5f66ce583-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Lock "cinder-66f4350c-25c8-4147-9325-cbd5f66ce583-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Acquiring lock "cinder-quobyte-66f4350c-25c8-4147-9325-cbd5f66ce583" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-66f4350c-25c8-4147-9325-cbd5f66ce583" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a38daa-2f3f-41cb-90bb-3b657facdc58]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:48 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583
Apr 13 11:24:48 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-edbf53c6-4226-4c56-aaab-f23b22655baa-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-edbf53c6-4226-4c56-aaab-f23b22655baa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-quobyte-edbf53c6-4226-4c56-aaab-f23b22655baa" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-edbf53c6-4226-4c56-aaab-f23b22655baa" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9be4ec4-d267-4b17-88ff-3537bc356390]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:49 devstack sudo[88512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa
Apr 13 11:24:49 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:49 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583" returned: 0 in 0.518s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:49 devstack sudo[88517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583
Apr 13 11:24:49 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:49 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa" returned: 0 in 0.493s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:49 devstack sudo[88522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa
Apr 13 11:24:49 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:49 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-66f4350c-25c8-4147-9325-cbd5f66ce583" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Lock "cinder-quobyte-66f4350c-25c8-4147-9325-cbd5f66ce583" released by "delete_volume" :: held 0.991s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Created reservations ['e31802ef-5ccb-413b-bc8c-175de139fd3d', '7562f189-2996-41cc-8428-f501ee004c34', 'c5dcf898-3af5-4955-9212-c2e9d0fa244b', 'be90830b-e4ae-4787-86c2-1bbc0b9cb85d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:49 devstack sudo[88525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:49 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:50 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-edbf53c6-4226-4c56-aaab-f23b22655baa" returned: 0 in 0.447s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-edbf53c6-4226-4c56-aaab-f23b22655baa" released by "delete_volume" :: held 0.963s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created reservations ['23e99e16-ce24-45f0-9518-86cd95040600', '8069f3b5-0f1a-41a2-a706-8c1a2a39623e', 'a45b4273-74d4-4e80-af80-0876ce231d83', 'a9a0da3d-20cd-4d04-8d74-3c153f898128'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:50 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:50 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-quobyte-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a844ef-0edf-4bbb-9eca-827a48e9c716]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:50 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4
Apr 13 11:24:50 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:50 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Deleted volume successfully.
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d5113378-d1c1-4304-b5c8-c16112aebbaf tempest-VolumesExtendTest-230081428 None] Lock "cinder-66f4350c-25c8-4147-9325-cbd5f66ce583-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:50 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.412s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Deleted volume successfully.
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-353b2bbf-1ac2-4f04-9ff0-ac1ac3849e6b tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-edbf53c6-4226-4c56-aaab-f23b22655baa-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:50 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4" returned: 0 in 0.503s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:50 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4
Apr 13 11:24:50 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:51 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4" returned: 0 in 0.462s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4" released by "delete_volume" :: held 0.987s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created reservations ['84564e18-f4b5-4f94-8cf8-09ba48d0e2a1', '96dd63ab-5d08-4a07-a0c5-60a83b8afaff', 'bc4cd87c-8702-4dc9-b4aa-cb28b452d542', '4eb9186d-ce87-4d02-9ded-5c42d5d73954'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:51 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:51 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:51 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Deleted volume successfully.
Apr 13 11:24:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-f2533c03-3122-4921-b559-03fe53ef63d7 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-bdf950ad-71f2-465e-8e48-e6b4e62d7ca4-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-0ea3d648-7782-4e57-a00f-c5d370690902-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-0ea3d648-7782-4e57-a00f-c5d370690902-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-quobyte-0ea3d648-7782-4e57-a00f-c5d370690902" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-0ea3d648-7782-4e57-a00f-c5d370690902" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8568b5-8896-444c-8e54-207f1f0a258d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:52 devstack sudo[88543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902
Apr 13 11:24:52 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (2e960382-db86-430e-bafc-ea9b09e88c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acd418a-f555-4025-8461-3dbb6276b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acd418a-f555-4025-8461-3dbb6276b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1332487114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03531083-9343-45b4-a5c6-b3356ad6ae9a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:53Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35250d14-3bff-49cb-bd25-0511f315e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35250d14-3bff-49cb-bd25-0511f315e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0551172b-f6ad-405e-808d-cc2a80e7bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0551172b-f6ad-405e-808d-cc2a80e7bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03531083-9343-45b4-a5c6-b3356ad6ae9a', 'volume_name': 'volume-03531083-9343-45b4-a5c6-b3356ad6ae9a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013aec60-a9aa-43d6-87aa-7d77f2c02c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013aec60-a9aa-43d6-87aa-7d77f2c02c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5577b3a6-bab4-4b0d-ac9f-6afeefd4377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:52 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Volume 03531083-9343-45b4-a5c6-b3356ad6ae9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03531083-9343-45b4-a5c6-b3356ad6ae9a', 'volume_size': 1}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1332487114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03531083-9343-45b4-a5c6-b3356ad6ae9a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:53Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Creating volume 03531083-9343-45b4-a5c6-b3356ad6ae9a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:52 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:53 devstack sudo[88548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a 1073741824
Apr 13 11:24:53 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:53 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902" returned: 0 in 0.544s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:53 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902
Apr 13 11:24:53 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:53 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0ea3d648-7782-4e57-a00f-c5d370690902" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-0ea3d648-7782-4e57-a00f-c5d370690902" released by "delete_volume" :: held 1.008s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created reservations ['bfa4d188-f6b4-4f85-b9be-28e2fb156b7e', 'b17596bf-f72c-4c46-95e6-ab7a2a5c7561', '4cb08c9e-4cb7-4a46-bf7a-e5e7f953b74d', '7e36d9b0-ec8a-4ca5-a789-31ef1c66c8d5'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:53 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a 1073741824" returned: 0 in 0.558s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:53 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a
Apr 13 11:24:53 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:53 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:53 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:53 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a" returned: 0 in 0.422s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:53 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5577b3a6-bab4-4b0d-ac9f-6afeefd4377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03531083-9343-45b4-a5c6-b3356ad6ae9a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31b8058-ea3f-44de-b5a9-78c750d809e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:54 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Volume volume-03531083-9343-45b4-a5c6-b3356ad6ae9a (03531083-9343-45b4-a5c6-b3356ad6ae9a): created successfully
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31b8058-ea3f-44de-b5a9-78c750d809e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (2e960382-db86-430e-bafc-ea9b09e88c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-4fdedace-9927-40eb-a233-f7dac7f3339e tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:24:54 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.495s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Deleted volume successfully.
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-49df5a4d-9469-4781-9826-daf9db23e2a8 tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-0ea3d648-7782-4e57-a00f-c5d370690902-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-58a244f8-87eb-4f15-81c7-e818421ba65c-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-58a244f8-87eb-4f15-81c7-e818421ba65c-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "cinder-quobyte-58a244f8-87eb-4f15-81c7-e818421ba65c" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-58a244f8-87eb-4f15-81c7-e818421ba65c" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[beebbf35-01eb-456f-9e6e-43099bb6764f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:54 devstack sudo[88562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c
Apr 13 11:24:54 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:55 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c" returned: 0 in 0.529s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:55 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c
Apr 13 11:24:55 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (d0c934bc-3e9d-4a4e-b78a-3c2552b227d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45678e57-baa9-4d7d-b74f-3ce4acb49013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45678e57-baa9-4d7d-b74f-3ce4acb49013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1668648083',display_name='tempest-VolumesGetTest-Volume-368705576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a165fa-d32e-4437-9c7f-7259e6393d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:55Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a970d4-682e-4bd3-bd88-ccbd694a7c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a970d4-682e-4bd3-bd88-ccbd694a7c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e780354-d4e8-4427-91d7-e327fe82e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e780354-d4e8-4427-91d7-e327fe82e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a165fa-d32e-4437-9c7f-7259e6393d3b', 'volume_name': 'volume-43a165fa-d32e-4437-9c7f-7259e6393d3b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0947f1-ce19-4f38-b000-3f4bdf59825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0947f1-ce19-4f38-b000-3f4bdf59825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3d5933-d1f9-4828-a25a-343e9ba9efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:55 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Volume 43a165fa-d32e-4437-9c7f-7259e6393d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a165fa-d32e-4437-9c7f-7259e6393d3b', 'volume_size': 1}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1668648083',display_name='tempest-VolumesGetTest-Volume-368705576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a165fa-d32e-4437-9c7f-7259e6393d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:55Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Creating volume 43a165fa-d32e-4437-9c7f-7259e6393d3b {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:55 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:55 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b 1073741824
Apr 13 11:24:55 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:55 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-58a244f8-87eb-4f15-81c7-e818421ba65c" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-quobyte-58a244f8-87eb-4f15-81c7-e818421ba65c" released by "delete_volume" :: held 1.026s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Created reservations ['68b6b859-ba20-46ee-8a94-b3e837937cc8', '4a3d25b1-d5af-487e-9ea2-67cb3f797850', '8063eb35-e479-4aec-8175-467dd9af41f7', '4cc2888e-63e2-4329-93aa-6b0ddb587d91'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:55 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:55 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:56 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b 1073741824" returned: 0 in 0.521s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:56 devstack sudo[88577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b
Apr 13 11:24:56 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:56 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.450s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:56 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Deleted volume successfully.
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ad51f30-804b-43d0-9015-4412048c7b7f tempest-CreateVolumesFromSourceVolumeTest-193453394 None] Lock "cinder-58a244f8-87eb-4f15-81c7-e818421ba65c-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:56 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b" returned: 0 in 0.422s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3d5933-d1f9-4828-a25a-343e9ba9efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a165fa-d32e-4437-9c7f-7259e6393d3b', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed704f-f981-46e3-a562-f99981f7d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:56 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Volume volume-43a165fa-d32e-4437-9c7f-7259e6393d3b (43a165fa-d32e-4437-9c7f-7259e6393d3b): created successfully
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed704f-f981-46e3-a562-f99981f7d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (d0c934bc-3e9d-4a4e-b78a-3c2552b227d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:56 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2f7cca69-1f4a-41be-9a5e-5e74cbc8a89f tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:24:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-43a165fa-d32e-4437-9c7f-7259e6393d3b-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Lock "cinder-43a165fa-d32e-4437-9c7f-7259e6393d3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-43a165fa-d32e-4437-9c7f-7259e6393d3b" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-43a165fa-d32e-4437-9c7f-7259e6393d3b" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:57 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb394f8e-9856-43f5-a84b-a5c1cb8658da]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:57 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b
Apr 13 11:24:57 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:58 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b" returned: 0 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:58 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b
Apr 13 11:24:58 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Flow 'volume_create_manager' (cd4cfe32-6a10-440e-9be9-3ffdfdc9c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ddb3da6-2806-4418-a46b-51248b9c64a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ddb3da6-2806-4418-a46b-51248b9c64a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d578ee-e735-4152-8bc6-8c29a3a41975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6dd62408564ca1bfe9f477365428aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:59Z,use_quota=True,user_id='44b57e598cdc43bfb6bf50ba5d2a9299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a28d8-aeaa-4531-b8a4-faca88d9616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a28d8-aeaa-4531-b8a4-faca88d9616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cef7fce-f09e-43e0-b851-be5dc3ac3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cef7fce-f09e-43e0-b851-be5dc3ac3255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d578ee-e735-4152-8bc6-8c29a3a41975', 'volume_name': 'volume-c4d578ee-e735-4152-8bc6-8c29a3a41975', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04baa5e-f3be-4c02-8e98-e9bba8117359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04baa5e-f3be-4c02-8e98-e9bba8117359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef8cc33-cac5-41eb-91d4-e366939152bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:58 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Volume c4d578ee-e735-4152-8bc6-8c29a3a41975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d578ee-e735-4152-8bc6-8c29a3a41975', 'volume_size': 1}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d578ee-e735-4152-8bc6-8c29a3a41975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6dd62408564ca1bfe9f477365428aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:24:59Z,use_quota=True,user_id='44b57e598cdc43bfb6bf50ba5d2a9299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Creating volume c4d578ee-e735-4152-8bc6-8c29a3a41975 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:24:58 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:58 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-43a165fa-d32e-4437-9c7f-7259e6393d3b" returned: 0 in 0.455s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:58 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 1073741824
Apr 13 11:24:58 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-43a165fa-d32e-4437-9c7f-7259e6393d3b" released by "delete_volume" :: held 0.992s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Created reservations ['22910685-7d2d-41da-bd4f-affcc25e59b2', '6c2ed9f3-3567-4c54-b346-1b3748ed626b', '128a26f6-4bdb-4121-b464-e146012f661d', '80d47a55-1261-4f58-825c-6a300c12d88e'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:58 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:24:58 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:59 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 1073741824" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:24:59 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975
Apr 13 11:24:59 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:24:59 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.450s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:24:59 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-789973b9-4df8-41f1-b608-722b640cabfe tempest-VolumesGetTest-65033955 None] Lock "cinder-43a165fa-d32e-4437-9c7f-7259e6393d3b-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:24:59 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975" returned: 0 in 0.424s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef8cc33-cac5-41eb-91d4-e366939152bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d578ee-e735-4152-8bc6-8c29a3a41975', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9a0e93-f135-4b1c-aa2a-f1a662c48da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:24:59 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Volume volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 (c4d578ee-e735-4152-8bc6-8c29a3a41975): created successfully
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9a0e93-f135-4b1c-aa2a-f1a662c48da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Flow 'volume_create_manager' (cd4cfe32-6a10-440e-9be9-3ffdfdc9c788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:24:59 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-35640eb2-bde3-476b-b85e-b9e198ba4eec tempest-CinderUnicodeTest-1378984049 None] Created volume successfully.
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-03531083-9343-45b4-a5c6-b3356ad6ae9a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Lock "cinder-03531083-9343-45b4-a5c6-b3356ad6ae9a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-03531083-9343-45b4-a5c6-b3356ad6ae9a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-03531083-9343-45b4-a5c6-b3356ad6ae9a" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac67e2-8269-4f96-ba18-5301ecee98e7]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:24:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:00 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a
Apr 13 11:25:00 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:00 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a" returned: 0 in 0.522s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:00 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a
Apr 13 11:25:00 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:00 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-03531083-9343-45b4-a5c6-b3356ad6ae9a" returned: 0 in 0.430s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-03531083-9343-45b4-a5c6-b3356ad6ae9a" released by "delete_volume" :: held 0.979s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:00 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Created reservations ['b9029adb-b4e4-46ae-bd95-3ded603a8bea', '1f24eda4-5a44-48c0-b7cd-b63867ac6e7c', '085dbc77-62e3-4816-8a72-3dd794215455', '4976ffed-bbdf-4f5c-a051-875f2ccf3a78'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:01 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:01 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Flow 'volume_create_manager' (54f547ef-be3e-43ef-afaf-9b18739d2ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3a8b5e-6ecd-4ebd-b477-ee1b16a7a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3a8b5e-6ecd-4ebd-b477-ee1b16a7a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1833869262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee96b4d-84e1-445d-a512-e3bbfdc79172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6dd62408564ca1bfe9f477365428aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:01Z,use_quota=True,user_id='44b57e598cdc43bfb6bf50ba5d2a9299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388609f1-7f6e-4883-9a1c-86f9a705513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388609f1-7f6e-4883-9a1c-86f9a705513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b03c7e9-246c-4574-8a0b-c4e809621066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b03c7e9-246c-4574-8a0b-c4e809621066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee96b4d-84e1-445d-a512-e3bbfdc79172', 'volume_name': 'volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba335e3c-52de-4554-868f-44886b11fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba335e3c-52de-4554-868f-44886b11fb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2396474-8836-4863-ba19-68f23bf5b76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:01 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Volume 2ee96b4d-84e1-445d-a512-e3bbfdc79172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172', 'volume_size': 1}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1833869262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee96b4d-84e1-445d-a512-e3bbfdc79172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6dd62408564ca1bfe9f477365428aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:01Z,use_quota=True,user_id='44b57e598cdc43bfb6bf50ba5d2a9299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Creating volume 2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:01 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:01 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 1073741824
Apr 13 11:25:01 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:01 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.455s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:01 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-3a31e834-9827-4f9a-8611-3cde059e5415 tempest-VolumesGetTest-65033955 None] Lock "cinder-03531083-9343-45b4-a5c6-b3356ad6ae9a-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:01 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 1073741824" returned: 0 in 0.554s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:01 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172
Apr 13 11:25:01 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:02 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2396474-8836-4863-ba19-68f23bf5b76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d86015e-6331-402e-9e99-bbf81284da89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:02 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Volume volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 (2ee96b4d-84e1-445d-a512-e3bbfdc79172): created successfully
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d86015e-6331-402e-9e99-bbf81284da89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Flow 'volume_create_manager' (54f547ef-be3e-43ef-afaf-9b18739d2ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:02 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3a2e78e1-e030-406e-9608-acbc37772d4b tempest-CinderUnicodeTest-1378984049 None] Created volume successfully.
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (fbadcc72-04fe-429d-8479-68b0e3aa06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0612758a-402b-4bed-958e-33a19d0c113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0612758a-402b-4bed-958e-33a19d0c113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1037048386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ef3b95-adfb-47f1-b360-ac7d57d40867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:02Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9878fc5e-52b3-4cc4-8d3c-b581ef576a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9878fc5e-52b3-4cc4-8d3c-b581ef576a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3f666d-d989-4fc3-84a2-8a3f80c2c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3f666d-d989-4fc3-84a2-8a3f80c2c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ef3b95-adfb-47f1-b360-ac7d57d40867', 'volume_name': 'volume-76ef3b95-adfb-47f1-b360-ac7d57d40867', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2e66bc-92e5-4556-9d6c-929c5defab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2e66bc-92e5-4556-9d6c-929c5defab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a51fa9-b591-4cf6-95e4-16447ceb5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:02 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Volume 76ef3b95-adfb-47f1-b360-ac7d57d40867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ef3b95-adfb-47f1-b360-ac7d57d40867', 'volume_size': 1}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1037048386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ef3b95-adfb-47f1-b360-ac7d57d40867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:02Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Creating volume 76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:02 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:02 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 1073741824
Apr 13 11:25:02 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:02 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 1073741824" returned: 0 in 0.534s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:02 devstack sudo[88627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:02 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:03 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.446s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a51fa9-b591-4cf6-95e4-16447ceb5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ef3b95-adfb-47f1-b360-ac7d57d40867', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c01dcb6-963a-4e1e-8a46-6e97169a6a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Creating offline snapshot dba6c9c0-80ab-4528-ab1a-971008e6305d of volume 2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:25:03 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Volume volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 (76ef3b95-adfb-47f1-b360-ac7d57d40867): created successfully
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c01dcb6-963a-4e1e-8a46-6e97169a6a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (fbadcc72-04fe-429d-8479-68b0e3aa06b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c2014-db44-4119-85fd-efc086f59d85]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:03 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-16bf9862-955a-4eb1-b3aa-192afde64a04 tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:25:03 devstack sudo[88630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172
Apr 13 11:25:03 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:03 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172" returned: 0 in 0.533s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:03 devstack sudo[88635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d 1G
Apr 13 11:25:03 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:04 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d 1G" returned: 0 in 0.519s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:04 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d
Apr 13 11:25:04 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (b427107d-1f60-4bf8-bded-2b0af695f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169b89cb-0bdd-478b-a6fe-d9c9d6a0534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169b89cb-0bdd-478b-a6fe-d9c9d6a0534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-235900148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542a8597-6011-4e9d-9ddb-90a46bbc24b8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=76ef3b95-adfb-47f1-b360-ac7d57d40867,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:05Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3273dab4-79bc-4ce6-8477-c85e06592b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3273dab4-79bc-4ce6-8477-c85e06592b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda99345-d132-451c-acd9-517c4172b931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda99345-d132-451c-acd9-517c4172b931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '542a8597-6011-4e9d-9ddb-90a46bbc24b8', 'volume_name': 'volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8', 'volume_size': 1, 'source_volid': '76ef3b95-adfb-47f1-b360-ac7d57d40867', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d4073d-88ae-43d6-a9db-0239401b45fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d4073d-88ae-43d6-a9db-0239401b45fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f83cdf2-fadb-4947-857a-8670cfff5fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:04 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Volume 542a8597-6011-4e9d-9ddb-90a46bbc24b8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8', 'volume_size': 1, 'source_volid': '76ef3b95-adfb-47f1-b360-ac7d57d40867', 'source_volstatus': 'available'}
Apr 13 11:25:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:05 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:05 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d is being set with open permissions: ugo+rw
Apr 13 11:25:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:05 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d
Apr 13 11:25:05 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:05 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d" returned: 0 in 0.460s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:05 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info
Apr 13 11:25:05 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:05 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:05 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info is being set with open permissions: ugo+rw
Apr 13 11:25:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:05 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info
Apr 13 11:25:05 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:06 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.info" returned: 0 in 0.454s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.583s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:06 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Cloning volume 76ef3b95-adfb-47f1-b360-ac7d57d40867 to volume 542a8597-6011-4e9d-9ddb-90a46bbc24b8
Apr 13 11:25:06 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c3743146-3b49-4161-a982-4d215708089f tempest-CinderUnicodeTest-1378984049 None] Create snapshot completed successfully
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Creating offline snapshot 4e217f28-2baa-4500-a7e9-1282f46424d2 of volume 76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7bdfec-4840-4c48-92e1-ab28a917cab0]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:06 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:06 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-dba6c9c0-80ab-4528-ab1a-971008e6305d-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-dba6c9c0-80ab-4528-ab1a-971008e6305d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-quobyte-2ee96b4d-84e1-445d-a512-e3bbfdc79172" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-2ee96b4d-84e1-445d-a512-e3bbfdc79172" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-quobyte-dba6c9c0-80ab-4528-ab1a-971008e6305d" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-dba6c9c0-80ab-4528-ab1a-971008e6305d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Deleting offline snapshot dba6c9c0-80ab-4528-ab1a-971008e6305d of volume 2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] snapshot_file for this snap is: volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050cbef-838f-4239-b24a-26e5fb407954]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:06 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d
Apr 13 11:25:06 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:06 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.525s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:07 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 1G
Apr 13 11:25:07 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:07 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f79f04-b85a-4e94-b02f-7659a37ed32c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:07 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172
Apr 13 11:25:07 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:07 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 1G" returned: 0 in 0.465s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:07 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2
Apr 13 11:25:07 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:07 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:07 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d
Apr 13 11:25:07 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:07 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2" returned: 0 in 0.444s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:07 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 is being set with open permissions: ugo+rw
Apr 13 11:25:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:07 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2
Apr 13 11:25:07 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:08 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:08 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d
Apr 13 11:25:08 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:08 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2" returned: 0 in 0.411s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:08 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info
Apr 13 11:25:08 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:08 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172.dba6c9c0-80ab-4528-ab1a-971008e6305d" returned: 0 in 0.425s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-dba6c9c0-80ab-4528-ab1a-971008e6305d" released by "_delete_snapshot" :: held 1.951s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-2ee96b4d-84e1-445d-a512-e3bbfdc79172" released by "delete_snapshot" :: held 1.970s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Created reservations ['b9af8655-67ee-48a7-a50c-f38bcadecd5e', '66b921cc-7ba7-4067-a6a0-3c837a4a45b5', 'b46a7250-a123-42fe-b69d-85cebd5e4466', '5acbfbd5-ee05-4aee-a187-70fbdf977e25'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Delete snapshot completed successfully.
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c3dc1f2f-143a-463d-9337-685033dd89c3 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-dba6c9c0-80ab-4528-ab1a-971008e6305d-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-2ee96b4d-84e1-445d-a512-e3bbfdc79172-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-2ee96b4d-84e1-445d-a512-e3bbfdc79172-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-quobyte-2ee96b4d-84e1-445d-a512-e3bbfdc79172" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-2ee96b4d-84e1-445d-a512-e3bbfdc79172" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba0d9b1-4cc6-4e81-8a87-a22bc50130a7]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:08 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info" returned: 0 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:08 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info is being set with open permissions: ugo+rw
Apr 13 11:25:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:08 devstack sudo[88701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info
Apr 13 11:25:08 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:08 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172
Apr 13 11:25:08 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:09 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.info" returned: 0 in 0.444s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-542a8597-6011-4e9d-9ddb-90a46bbc24b8" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-542a8597-6011-4e9d-9ddb-90a46bbc24b8" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] snapshot: 4e217f28-2baa-4500-a7e9-1282f46424d2, volume: 542a8597-6011-4e9d-9ddb-90a46bbc24b8,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:09 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05985b-e9d3-4cb1-b436-b0ea0a729b60]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:09 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172
Apr 13 11:25:09 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:09 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2
Apr 13 11:25:09 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:09 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2ee96b4d-84e1-445d-a512-e3bbfdc79172" returned: 0 in 0.396s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-2ee96b4d-84e1-445d-a512-e3bbfdc79172" released by "delete_volume" :: held 0.949s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Created reservations ['dc937222-0014-4358-95a9-7c64fbabcde0', '70c53080-7d46-4770-90f2-6212eb0d030f', '766b8a87-22b8-437f-b541-170a1193f015', '3e3eb7e6-a61b-47ac-aea1-353ef34e2787'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:09 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:09 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:09 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2" returned: 0 in 0.526s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ef3b95-adfb-47f1-b360-ac7d57d40867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce0642-5c02-471f-aeb4-d1117b215081]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-c4d578ee-e735-4152-8bc6-8c29a3a41975-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-c4d578ee-e735-4152-8bc6-8c29a3a41975-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "cinder-quobyte-c4d578ee-e735-4152-8bc6-8c29a3a41975" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-c4d578ee-e735-4152-8bc6-8c29a3a41975" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[69886991-37b8-4fc4-b2b4-889f8598966a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:09 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:09 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:09 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975
Apr 13 11:25:09 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:10 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:10 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Deleted volume successfully.
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-38df1493-2a0d-4f83-834e-b5d694774252 tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-2ee96b4d-84e1-445d-a512-e3bbfdc79172-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:10 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.512s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:10 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8
Apr 13 11:25:10 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:10 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:10 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975
Apr 13 11:25:10 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:10 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:10 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:10 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-c4d578ee-e735-4152-8bc6-8c29a3a41975" returned: 0 in 0.526s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:10 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-quobyte-c4d578ee-e735-4152-8bc6-8c29a3a41975" released by "delete_volume" :: held 1.081s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Created reservations ['7e77d9c7-7bc9-4b08-8759-7f2226663084', '1f5b26ed-95d8-4dc2-be1b-6416c12ba473', '4781923b-6fe7-4602-943a-04f44b2fdd68', '04db0a9b-6698-4687-a47d-58864ec3d581'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:11 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:11 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:12 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.690s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:12 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 1.337s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:12 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Deleted volume successfully.
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5ffc222c-3791-458a-a6aa-a08221ca1aea tempest-CinderUnicodeTest-1378984049 None] Lock "cinder-c4d578ee-e735-4152-8bc6-8c29a3a41975-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:12 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8" returned: 0 in 2.367s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb372472-5ef5-4d12-97a4-6ed405be5fbd]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:12 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:12 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:13 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.693s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:25:13 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Converted 1024.00 MB image at 432.51 MB/s
Apr 13 11:25:13 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 is being set with open permissions: ugo+rw
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:13 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8
Apr 13 11:25:13 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:13 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8" returned: 0 in 0.408s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-542a8597-6011-4e9d-9ddb-90a46bbc24b8" released by "_copy_volume_from_snapshot" :: held 4.555s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-4e217f28-2baa-4500-a7e9-1282f46424d2" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-4e217f28-2baa-4500-a7e9-1282f46424d2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Deleting offline snapshot 4e217f28-2baa-4500-a7e9-1282f46424d2 of volume 76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] snapshot_file for this snap is: volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b9314-945a-497f-b966-f0ea43561124]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:13 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2
Apr 13 11:25:13 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:14 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2" returned: 0 in 0.455s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ef3b95-adfb-47f1-b360-ac7d57d40867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:25:14 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c658bb-a625-4141-9bde-7bbeb93372e8]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:14 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:14 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:14 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.457s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:14 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2
Apr 13 11:25:14 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:15 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2" returned: 0 in 0.432s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:15 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2
Apr 13 11:25:15 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:15 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867.4e217f28-2baa-4500-a7e9-1282f46424d2" returned: 0 in 0.408s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-4e217f28-2baa-4500-a7e9-1282f46424d2" released by "_delete_snapshot" :: held 1.798s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.234s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f83cdf2-fadb-4947-857a-8670cfff5fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8', 'volume_size': 1, 'source_volid': '76ef3b95-adfb-47f1-b360-ac7d57d40867', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5146aa6-7712-4db5-95a7-b53fd63ee7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Volume volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 (542a8597-6011-4e9d-9ddb-90a46bbc24b8): created successfully
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5146aa6-7712-4db5-95a7-b53fd63ee7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (b427107d-1f60-4bf8-bded-2b0af695f78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:15 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-945ce9f7-6d60-4c1a-9ae2-d80eeef96e3e tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (0fd599e2-0a5e-4a1e-af24-a57eeb5cc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56469cdc-343f-4aa5-8e18-94ed7eb816f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56469cdc-343f-4aa5-8e18-94ed7eb816f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-96499609',display_name='tempest-VolumesGetTest-Volume-331324441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673d1457-e0eb-40ab-ae75-9b87687f4ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:17Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35167a10-c3f8-41ba-a5ef-487b417b9a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35167a10-c3f8-41ba-a5ef-487b417b9a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371de183-512a-4f9b-9668-4c733f9ed3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371de183-512a-4f9b-9668-4c733f9ed3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673d1457-e0eb-40ab-ae75-9b87687f4ce7', 'volume_name': 'volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194cf152-7772-4ba4-a92c-eecbd24341cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194cf152-7772-4ba4-a92c-eecbd24341cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbd956d-749a-4be1-b821-a7c5efd3b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Volume 673d1457-e0eb-40ab-ae75-9b87687f4ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7', 'volume_size': 1}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-96499609',display_name='tempest-VolumesGetTest-Volume-331324441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673d1457-e0eb-40ab-ae75-9b87687f4ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:17Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Creating volume 673d1457-e0eb-40ab-ae75-9b87687f4ce7 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:17 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:17 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 1073741824
Apr 13 11:25:17 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:17 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 1073741824" returned: 0 in 0.506s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:17 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7
Apr 13 11:25:17 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:17 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7" returned: 0 in 0.424s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbd956d-749a-4be1-b821-a7c5efd3b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d91731-63e2-40a6-ae96-e35b81828f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Volume volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 (673d1457-e0eb-40ab-ae75-9b87687f4ce7): created successfully
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d91731-63e2-40a6-ae96-e35b81828f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (0fd599e2-0a5e-4a1e-af24-a57eeb5cc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e01aef24-ad00-48f7-b72f-d0a6b469de80 tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-673d1457-e0eb-40ab-ae75-9b87687f4ce7-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Lock "cinder-673d1457-e0eb-40ab-ae75-9b87687f4ce7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-673d1457-e0eb-40ab-ae75-9b87687f4ce7" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-673d1457-e0eb-40ab-ae75-9b87687f4ce7" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bf51c-aad7-4f5d-adcd-99746dff1917]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:19 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7
Apr 13 11:25:19 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:19 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:19 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7
Apr 13 11:25:19 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:20 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-673d1457-e0eb-40ab-ae75-9b87687f4ce7" returned: 0 in 0.399s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-673d1457-e0eb-40ab-ae75-9b87687f4ce7" released by "delete_volume" :: held 0.889s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Created reservations ['5c523bf9-34ee-49cc-8547-d1d22b0c3dd4', 'dfbed947-1997-4ecb-b0b5-9c583205caa6', '3ff38c73-a51a-4d2c-a348-7d577cc492a5', '94cc7bd8-7f5f-4d98-b250-3757d0d48f60'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:20 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:20 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-542a8597-6011-4e9d-9ddb-90a46bbc24b8-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Lock "cinder-542a8597-6011-4e9d-9ddb-90a46bbc24b8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-542a8597-6011-4e9d-9ddb-90a46bbc24b8" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-542a8597-6011-4e9d-9ddb-90a46bbc24b8" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c04dd5-4ace-44a9-958e-3339b20ba270]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:20 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8
Apr 13 11:25:20 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:20 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-e25fe142-c29b-480e-9094-39b61df13530 tempest-VolumesGetTest-65033955 None] Lock "cinder-673d1457-e0eb-40ab-ae75-9b87687f4ce7-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:20 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8" returned: 0 in 0.533s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:20 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8
Apr 13 11:25:20 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:21 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-542a8597-6011-4e9d-9ddb-90a46bbc24b8" returned: 0 in 0.449s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-542a8597-6011-4e9d-9ddb-90a46bbc24b8" released by "delete_volume" :: held 1.018s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Created reservations ['f6aecb27-062e-4213-9c2f-3dcb3b385cc8', '01c8db4d-2037-4f40-916f-f12f76188512', '439e973a-0929-488f-b0f8-1fbbd1a9f646', 'c8488176-ac58-4710-bb2c-5398a8abc6f1'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:21 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:21 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:21 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.419s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:21 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:25:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fd9e1028-b143-43ac-af17-58aa871dd74a tempest-VolumesGetTest-65033955 None] Lock "cinder-542a8597-6011-4e9d-9ddb-90a46bbc24b8-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-76ef3b95-adfb-47f1-b360-ac7d57d40867-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Lock "cinder-76ef3b95-adfb-47f1-b360-ac7d57d40867-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-76ef3b95-adfb-47f1-b360-ac7d57d40867" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-76ef3b95-adfb-47f1-b360-ac7d57d40867" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:22 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac907dae-494a-46e5-8bf3-27516f9a8828]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:22 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:22 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:23 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:23 devstack sudo[89077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867
Apr 13 11:25:23 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:23 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-76ef3b95-adfb-47f1-b360-ac7d57d40867" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-76ef3b95-adfb-47f1-b360-ac7d57d40867" released by "delete_volume" :: held 0.927s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Created reservations ['9b9b4503-fd2c-4ba8-a843-ba9e9c438d17', '40444ca6-4971-438b-9771-2541d47f5533', '58ad73ba-8b4c-4bb2-8043-ba1dd9cd55c9', '61a51d14-9d1d-49ce-8798-7a56e2dc627b'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:23 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:23 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:24 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.524s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:24 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=197,cinder:SELECT=135,cinder:INSERT=53,cinder:DELETE=16 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-95d53d71-7484-4524-b85d-9f1575526172 tempest-VolumesGetTest-65033955 None] Lock "cinder-76ef3b95-adfb-47f1-b360-ac7d57d40867-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=148,cinder:INSERT=51,cinder:UPDATE=197,cinder:DELETE=18 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (ee18b493-5d59-44c6-8713-68569247cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35000d16-529f-4494-8850-e4f7900c3f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35000d16-529f-4494-8850-e4f7900c3f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1288634888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa2931a-296e-4769-ba78-9a20d0923d37,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:24Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7625c2f6-5bfc-4ff9-ab40-29d45c2070e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7625c2f6-5bfc-4ff9-ab40-29d45c2070e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec10d11-51a6-491f-b053-eb2210854a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.image.glance [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Creating Keystone auth plugin from conf {{(pid=82099) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec10d11-51a6-491f-b053-eb2210854a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0aa2931a-296e-4769-ba78-9a20d0923d37', 'volume_name': 'volume-0aa2931a-296e-4769-ba78-9a20d0923d37', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa500de1060>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e7e6d4-a6d9-42c2-9efd-e9e705ffd1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e7e6d4-a6d9-42c2-9efd-e9e705ffd1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2fd163-d59d-4340-bf6c-615e9a4ea03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:24 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Volume 0aa2931a-296e-4769-ba78-9a20d0923d37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0aa2931a-296e-4769-ba78-9a20d0923d37', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa500de1060>}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Trying to clone 0aa2931a-296e-4769-ba78-9a20d0923d37 from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]). {{(pid=82099) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 11:25:24 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198017c-d327-44b9-ad47-9c583a2e5259]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:24 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD
Apr 13 11:25:24 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:25 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 is fetched for user e7ba6d5305ac4562a728499c58e9066b. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85f60f2-7122-489e-b830-784530911e28]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:25 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD
Apr 13 11:25:25 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:25 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1288634888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa2931a-296e-4769-ba78-9a20d0923d37,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:24Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Creating volume 0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:25 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:25 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 1073741824
Apr 13 11:25:25 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:26 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 1073741824" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:26 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:26 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:26 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 0 in 0.414s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Attempting download of ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 0aa2931a-296e-4769-ba78-9a20d0923d37. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3b958-cadc-4da3-bdad-4b174c917417]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:26 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod
Apr 13 11:25:26 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:27 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod" returned: 0 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:27 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod
Apr 13 11:25:27 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:27 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod" returned: 1 in 0.460s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ffc1a9fa-e3a7-4577-9cbc-998b14363590_3nugbfod' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:25:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372079f-9bd7-4f45-bbae-a40a733f6a24]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:27 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD
Apr 13 11:25:27 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:28 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:28 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] ffc1a9fa-e3a7-4577-9cbc-998b14363590 was qcow2, converting to raw {{(pid=82099) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 11:25:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:28 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:28 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:28 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 0 in 0.840s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:28 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ffc1a9fa-e3a7-4577-9cbc-998b14363590_d205kwkrdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:25:28 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Converted 112.00 MB image at 112.00 MB/s
Apr 13 11:25:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:28 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 1G
Apr 13 11:25:28 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:29 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 1G" returned: 0 in 0.440s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:29 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c31f606-4991-4d4e-9ecf-673568044127]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:29 devstack sudo[89138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:29 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:29 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 0 in 0.472s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:29 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:29 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:30 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 1 in 0.476s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Downloaded image ffc1a9fa-e3a7-4577-9cbc-998b14363590 ((None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}])) to volume 0aa2931a-296e-4769-ba78-9a20d0923d37 successfully. {{(pid=82099) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Temporary image ffc1a9fa-e3a7-4577-9cbc-998b14363590 for user e7ba6d5305ac4562a728499c58e9066b is deleted. {{(pid=82099) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.volume_utils [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Marking volume 0aa2931a-296e-4769-ba78-9a20d0923d37 as bootable. {{(pid=82099) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Copying metadata from image ffc1a9fa-e3a7-4577-9cbc-998b14363590 to 0aa2931a-296e-4769-ba78-9a20d0923d37. {{(pid=82099) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Creating volume glance metadata for volume 0aa2931a-296e-4769-ba78-9a20d0923d37 backed by image ffc1a9fa-e3a7-4577-9cbc-998b14363590 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82099) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2fd163-d59d-4340-bf6c-615e9a4ea03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa2931a-296e-4769-ba78-9a20d0923d37', 'volume_size': 1, 'image_id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8476a42fb32f41f0b9a6eebe99faaf2a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ffc1a9fa-e3a7-4577-9cbc-998b14363590', 'created_at': datetime.datetime(2026, 4, 13, 9, 12, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 9, 12, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ffc1a9fa-e3a7-4577-9cbc-998b14363590/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fa500de1060>}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352bb30-4aeb-4fec-af8e-b1539bd51eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Volume volume-0aa2931a-296e-4769-ba78-9a20d0923d37 (0aa2931a-296e-4769-ba78-9a20d0923d37): created successfully
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352bb30-4aeb-4fec-af8e-b1539bd51eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (ee18b493-5d59-44c6-8713-68569247cf18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7916d020-fa45-466c-bd77-b75480227b3d tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (1c0f1a27-6bcb-4550-bf06-84c5a773bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d76d87-9f4a-4c20-9383-21466bf69281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d76d87-9f4a-4c20-9383-21466bf69281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-405083378',display_name='tempest-VolumesGetTest-Volume-674183175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:31Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55b41d6-c25b-4368-9b08-eb75d2af7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55b41d6-c25b-4368-9b08-eb75d2af7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ee861b-f77f-40e1-9f1f-a993c191f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ee861b-f77f-40e1-9f1f-a993c191f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7', 'volume_name': 'volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7198db-f5d9-4bde-ad0a-aa4aff12fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7198db-f5d9-4bde-ad0a-aa4aff12fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f6ffab-28fe-44eb-b8b7-d782e7042ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:31 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Volume 2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7', 'volume_size': 1}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-405083378',display_name='tempest-VolumesGetTest-Volume-674183175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695b9f7e720841d1a583bd22f9e89c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:31Z,use_quota=True,user_id='e7ba6d5305ac4562a728499c58e9066b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Creating volume 2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:31 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:31 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 1073741824
Apr 13 11:25:31 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:31 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 1073741824" returned: 0 in 0.491s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:31 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7
Apr 13 11:25:31 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:31 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f6ffab-28fe-44eb-b8b7-d782e7042ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c64d79-9c13-4ff0-8ae7-24401aeb27b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:32 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Volume volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 (2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7): created successfully
Apr 13 11:25:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c64d79-9c13-4ff0-8ae7-24401aeb27b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:32 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Flow 'volume_create_manager' (1c0f1a27-6bcb-4550-bf06-84c5a773bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:32 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-74449d53-4b33-4507-a6b9-87d8e6f2f8af tempest-VolumesGetTest-65033955 None] Created volume successfully.
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Lock "cinder-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb569208-650f-4883-bcf9-e9843f26a3af]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:33 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7
Apr 13 11:25:33 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:33 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7" returned: 0 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:33 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7
Apr 13 11:25:33 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:34 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7" returned: 0 in 0.446s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7" released by "delete_volume" :: held 0.941s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Created reservations ['c7bf5f1a-5598-4d05-b182-3b8f53e5f857', '154e96e0-a5b0-47cd-900a-fc9fbbaccd8f', 'a39d2214-cc59-4461-ae9a-8d3b35ddd7b6', '313dbf84-f3dd-46e9-a7f0-419e7e0b6a86'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:34 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:34 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-0aa2931a-296e-4769-ba78-9a20d0923d37-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Lock "cinder-0aa2931a-296e-4769-ba78-9a20d0923d37-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Acquiring lock "cinder-quobyte-0aa2931a-296e-4769-ba78-9a20d0923d37" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-0aa2931a-296e-4769-ba78-9a20d0923d37" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fe6a9-fda2-4371-b5f8-3a0d643d8491]: (4, 'raw') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:34 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:34 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:34 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.457s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-a03079db-e843-429f-ab90-a67e11948cb9 tempest-VolumesGetTest-65033955 None] Lock "cinder-2b32ca9b-99f8-4dad-8c43-e2f81ea03ee7-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:34 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 0 in 0.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:34 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:34 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:35 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 1 in 0.469s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37' failed. Not Retrying. {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:35 devstack sudo[89175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37
Apr 13 11:25:35 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:35 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0aa2931a-296e-4769-ba78-9a20d0923d37" returned: 0 in 0.414s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Lock "cinder-quobyte-0aa2931a-296e-4769-ba78-9a20d0923d37" released by "delete_volume" :: held 1.398s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Created reservations ['b71c5f1a-d199-4b44-905f-0818b97b8afa', 'f1b60bf6-000f-4fcd-bae9-9b1e6050d381', '8890a603-46f4-4bfb-b242-1864ec293cfa', 'f4daa0ab-f8b8-45d4-9491-5e02b4c02605'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:35 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:25:35 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:36 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.405s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:36 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:25:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Deleted volume successfully.
Apr 13 11:25:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7be3b330-e9b4-41f4-9a51-d58a2f7ffc7c tempest-VolumesGetTest-65033955 None] Lock "cinder-0aa2931a-296e-4769-ba78-9a20d0923d37-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (1cfa6f71-54ae-4ff0-97ed-b223f44100ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ca95c8-17a0-4981-b5ca-7ab949d9fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ca95c8-17a0-4981-b5ca-7ab949d9fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-341166132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d959e6-f13a-497a-bd7d-22140de9e04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:43Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839d09d1-dabd-41e2-b5da-acabde74a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839d09d1-dabd-41e2-b5da-acabde74a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f17e4a-2a4b-442a-b513-97dfe63b6838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f17e4a-2a4b-442a-b513-97dfe63b6838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d959e6-f13a-497a-bd7d-22140de9e04f', 'volume_name': 'volume-f7d959e6-f13a-497a-bd7d-22140de9e04f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29afdeee-6c79-46d7-8591-bcad7102f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29afdeee-6c79-46d7-8591-bcad7102f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4107af4-2b74-4bb2-b0f1-39f1ac022e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:43 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume f7d959e6-f13a-497a-bd7d-22140de9e04f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d959e6-f13a-497a-bd7d-22140de9e04f', 'volume_size': 1}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-341166132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d959e6-f13a-497a-bd7d-22140de9e04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:43Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Creating volume f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:43 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:43 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f 1073741824
Apr 13 11:25:43 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:43 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f 1073741824" returned: 0 in 0.500s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:43 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f
Apr 13 11:25:43 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:44 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4107af4-2b74-4bb2-b0f1-39f1ac022e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d959e6-f13a-497a-bd7d-22140de9e04f', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd0d0c6-760c-4ccb-9449-6191f9455f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:44 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume volume-f7d959e6-f13a-497a-bd7d-22140de9e04f (f7d959e6-f13a-497a-bd7d-22140de9e04f): created successfully
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd0d0c6-760c-4ccb-9449-6191f9455f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (1cfa6f71-54ae-4ff0-97ed-b223f44100ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9b036165-5eb6-4811-8d5a-54b22ed67d36 tempest-VolumesSnapshotTestJSON-1424988278 None] Created volume successfully.
Apr 13 11:25:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Creating offline snapshot 2b8682c9-f520-470a-ac86-0162a5d59371 of volume f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:25:45 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e1913-4656-4646-8c63-09d8446d2a76]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:45 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f
Apr 13 11:25:45 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:46 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f" returned: 0 in 0.453s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:46 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 1G
Apr 13 11:25:46 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:46 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 1G" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d959e6-f13a-497a-bd7d-22140de9e04f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:46 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d959e6-f13a-497a-bd7d-22140de9e04f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371
Apr 13 11:25:46 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:46 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d959e6-f13a-497a-bd7d-22140de9e04f -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371" returned: 0 in 0.416s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:46 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 is being set with open permissions: ugo+rw
Apr 13 11:25:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:46 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371
Apr 13 11:25:46 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:47 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371" returned: 0 in 0.394s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:47 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info
Apr 13 11:25:47 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:47 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info" returned: 0 in 0.390s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:47 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info is being set with open permissions: ugo+rw
Apr 13 11:25:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:47 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info
Apr 13 11:25:47 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:48 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.info" returned: 0 in 0.393s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-850bed1b-3990-4fce-a957-cbc14c5ad8de tempest-VolumesSnapshotTestJSON-1424988278 None] Create snapshot completed successfully
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-2b8682c9-f520-470a-ac86-0162a5d59371-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-2b8682c9-f520-470a-ac86-0162a5d59371-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-f7d959e6-f13a-497a-bd7d-22140de9e04f" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-f7d959e6-f13a-497a-bd7d-22140de9e04f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-2b8682c9-f520-470a-ac86-0162a5d59371" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-2b8682c9-f520-470a-ac86-0162a5d59371" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleting offline snapshot 2b8682c9-f520-470a-ac86-0162a5d59371 of volume f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] snapshot_file for this snap is: volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9f20b-cc05-489d-a93c-052150b8b57a]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:48 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371
Apr 13 11:25:48 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:49 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371" returned: 0 in 0.465s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7d959e6-f13a-497a-bd7d-22140de9e04f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:25:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c15b6-af9e-4adf-9a95-4866683ef2ad]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:49 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f
Apr 13 11:25:49 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:49 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f" returned: 0 in 0.453s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:49 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371
Apr 13 11:25:49 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:50 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371" returned: 0 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:50 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371
Apr 13 11:25:50 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:50 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f.2b8682c9-f520-470a-ac86-0162a5d59371" returned: 0 in 0.399s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-2b8682c9-f520-470a-ac86-0162a5d59371" released by "_delete_snapshot" :: held 1.837s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-f7d959e6-f13a-497a-bd7d-22140de9e04f" released by "delete_snapshot" :: held 1.849s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['53bbbee5-266a-413c-820e-8542863f544b', '6392ab6f-9af2-4959-8b11-a1cef74ea812', 'dc1b14fc-a80b-406c-b952-ea82a852f255', '9fa2dae7-8b07-47dc-ab33-a13f3faf3040'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:25:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Delete snapshot completed successfully.
Apr 13 11:25:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7234b3eb-2512-4aef-933b-9acd12e9b127 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-2b8682c9-f520-470a-ac86-0162a5d59371-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (2b83bb3c-b01e-4439-b0b6-73910ea276d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a602d3b-68e6-4616-9db7-dffc379c03f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a602d3b-68e6-4616-9db7-dffc379c03f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-843271529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0c833e-48fb-4035-a187-0e4f90965998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:51Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13e7945-6360-460d-9e2d-468fc8a90625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13e7945-6360-460d-9e2d-468fc8a90625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114e426b-de10-4cc5-b227-becca9737d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (114e426b-de10-4cc5-b227-becca9737d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0c833e-48fb-4035-a187-0e4f90965998', 'volume_name': 'volume-9c0c833e-48fb-4035-a187-0e4f90965998', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f9b07a-d14d-498d-9da1-7f5208590031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f9b07a-d14d-498d-9da1-7f5208590031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7279cf27-c9e6-4faa-b361-5dfbc05d7495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:51 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume 9c0c833e-48fb-4035-a187-0e4f90965998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0c833e-48fb-4035-a187-0e4f90965998', 'volume_size': 1}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-843271529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0c833e-48fb-4035-a187-0e4f90965998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:51Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Creating volume 9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:51 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:51 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 1073741824
Apr 13 11:25:51 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:51 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 1073741824" returned: 0 in 0.477s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:51 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:25:51 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:52 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.413s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7279cf27-c9e6-4faa-b361-5dfbc05d7495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0c833e-48fb-4035-a187-0e4f90965998', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c108ea22-fbde-462d-a62a-55823e0d74aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:52 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume volume-9c0c833e-48fb-4035-a187-0e4f90965998 (9c0c833e-48fb-4035-a187-0e4f90965998): created successfully
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c108ea22-fbde-462d-a62a-55823e0d74aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:52 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (2b83bb3c-b01e-4439-b0b6-73910ea276d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:52 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-66223387-6da8-45c5-ade6-eb1be3f32783 tempest-VolumesSnapshotTestJSON-1424988278 None] Created volume successfully.
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Creating offline snapshot 17bdf7d6-109a-4057-9662-ecf932464dd6 of volume 9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce050c64-8af9-4bf3-b35a-88f3a262db16]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:53 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:25:53 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:53 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.472s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:53 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 1G
Apr 13 11:25:53 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:54 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 1G" returned: 0 in 0.460s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0c833e-48fb-4035-a187-0e4f90965998 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:54 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0c833e-48fb-4035-a187-0e4f90965998 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6
Apr 13 11:25:54 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:54 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0c833e-48fb-4035-a187-0e4f90965998 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6" returned: 0 in 0.416s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:54 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 is being set with open permissions: ugo+rw
Apr 13 11:25:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:54 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6
Apr 13 11:25:54 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:55 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6" returned: 0 in 0.404s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:55 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info
Apr 13 11:25:55 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:55 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info" returned: 0 in 0.409s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:55 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info is being set with open permissions: ugo+rw
Apr 13 11:25:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:55 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info
Apr 13 11:25:55 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:55 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.info" returned: 0 in 0.405s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:56 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8f300ffe-a1c8-42ea-a4e9-eb6c368a0b9c tempest-VolumesSnapshotTestJSON-1424988278 None] Create snapshot completed successfully
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (ff436d9c-2a34-4137-b51c-b7852334b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9aa4ca-6bbe-4b42-beab-cf1219200e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9aa4ca-6bbe-4b42-beab-cf1219200e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-341940948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1cb9fe-a9e4-498c-9bfa-eb757593dd37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:25:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=17bdf7d6-109a-4057-9662-ecf932464dd6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:25:57Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e15ddb-6396-4c19-abfe-0aa2dbb25b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e15ddb-6396-4c19-abfe-0aa2dbb25b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ddb73-40bc-4320-88dc-eb5959459c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac3ddb73-40bc-4320-88dc-eb5959459c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a1cb9fe-a9e4-498c-9bfa-eb757593dd37', 'volume_name': 'volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37', 'volume_size': 2, 'snapshot_id': '17bdf7d6-109a-4057-9662-ecf932464dd6'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72500817-933a-43cf-8ddf-538206b06c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72500817-933a-43cf-8ddf-538206b06c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941f71d2-df76-4965-a1f9-91f1a28b1033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:25:56 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume 6a1cb9fe-a9e4-498c-9bfa-eb757593dd37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37', 'volume_size': 2, 'snapshot_id': '17bdf7d6-109a-4057-9662-ecf932464dd6'}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-17bdf7d6-109a-4057-9662-ecf932464dd6-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-17bdf7d6-109a-4057-9662-ecf932464dd6-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Creating volume 6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 from snapshot 17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] snapshot: 17bdf7d6-109a-4057-9662-ecf932464dd6, volume: 6a1cb9fe-a9e4-498c-9bfa-eb757593dd37,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e0bbe-fa28-4239-82e8-c79a656129ea]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:56 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6
Apr 13 11:25:56 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:57 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6" returned: 0 in 0.500s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c0c833e-48fb-4035-a187-0e4f90965998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3defcf2-d36d-4b23-9482-261f09e0f4e9]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:57 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:25:57 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:57 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:25:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:57 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37
Apr 13 11:25:57 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:25:59 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 13 11:25:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" returned: 0 in 1.920s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:25:59 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab2f9e4-c1e7-401f-b0c8-43548edfd250]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:25:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:25:59 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:25:59 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:00 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.570s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:26:00 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Converted 1024.00 MB image at 532.91 MB/s
Apr 13 11:26:00 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 is being set with open permissions: ugo+rw
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:00 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37
Apr 13 11:26:00 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:00 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" returned: 0 in 0.393s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" released by "_copy_volume_from_snapshot" :: held 3.912s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-17bdf7d6-109a-4057-9662-ecf932464dd6-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" released by "_create_volume_from_snapshot" :: held 3.929s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.938s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941f71d2-df76-4965-a1f9-91f1a28b1033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37', 'volume_size': 2, 'snapshot_id': '17bdf7d6-109a-4057-9662-ecf932464dd6'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7e5a2a-f414-4ed5-92e3-033271e1882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:00 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 (6a1cb9fe-a9e4-498c-9bfa-eb757593dd37): created successfully
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7e5a2a-f414-4ed5-92e3-033271e1882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:00 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (ff436d9c-2a34-4137-b51c-b7852334b509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:00 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5746c9a2-bae2-4dcc-b82b-0ad9cdac67d4 tempest-VolumesSnapshotTestJSON-1424988278 None] Created volume successfully.
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae640fb-72d5-4f08-b5cb-6998331600b4]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:01 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37
Apr 13 11:26:01 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:01 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" returned: 0 in 0.452s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:01 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37
Apr 13 11:26:01 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:01 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" returned: 0 in 0.396s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37" released by "delete_volume" :: held 0.868s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['4397806c-d8a3-4691-8e42-542512b00397', '28b9bfdb-bd3e-4210-b21f-3f842290c3f3', '92f3d79c-d06a-448b-9117-88de1ccbc37b', '1e66909d-048a-47ea-9f67-5199e2cc5dac'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:02 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:02 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-17bdf7d6-109a-4057-9662-ecf932464dd6-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-17bdf7d6-109a-4057-9662-ecf932464dd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-9c0c833e-48fb-4035-a187-0e4f90965998" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-9c0c833e-48fb-4035-a187-0e4f90965998" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-17bdf7d6-109a-4057-9662-ecf932464dd6" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-17bdf7d6-109a-4057-9662-ecf932464dd6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Deleting offline snapshot 17bdf7d6-109a-4057-9662-ecf932464dd6 of volume 9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] snapshot_file for this snap is: volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541ce5f-c85f-408e-9358-3d28b894781e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:02 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6
Apr 13 11:26:02 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:02 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.425s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:02 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleted volume successfully.
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-47c99920-e2ef-4c54-ba34-265a62308876 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-6a1cb9fe-a9e4-498c-9bfa-eb757593dd37-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:02 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c0c833e-48fb-4035-a187-0e4f90965998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c02be-39f6-4f0e-b878-c56a5819ba83]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:02 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:26:02 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:03 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.439s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:03 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6
Apr 13 11:26:03 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:03 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6" returned: 0 in 0.427s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:03 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6
Apr 13 11:26:03 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:04 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998.17bdf7d6-109a-4057-9662-ecf932464dd6" returned: 0 in 0.401s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-17bdf7d6-109a-4057-9662-ecf932464dd6" released by "_delete_snapshot" :: held 1.785s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-9c0c833e-48fb-4035-a187-0e4f90965998" released by "delete_snapshot" :: held 1.800s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['a5a3fd3b-ff85-413c-bd9b-435d2ce3d700', 'f9473f63-08e3-4925-a25a-25c0095dcde0', 'ac877065-9b62-4bfd-b266-ec7b9bb95ead', 'bf6381d0-dfb6-4703-9c4a-a3275ea601d8'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Delete snapshot completed successfully.
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-07115170-832c-403a-bc66-43f138af2eed tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-17bdf7d6-109a-4057-9662-ecf932464dd6-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-9c0c833e-48fb-4035-a187-0e4f90965998-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-9c0c833e-48fb-4035-a187-0e4f90965998-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-9c0c833e-48fb-4035-a187-0e4f90965998" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-9c0c833e-48fb-4035-a187-0e4f90965998" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ab91e-0988-4b33-8cf5-48f954f9b34f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:04 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:26:04 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:04 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.456s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:04 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998
Apr 13 11:26:04 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:05 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9c0c833e-48fb-4035-a187-0e4f90965998" returned: 0 in 0.388s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-9c0c833e-48fb-4035-a187-0e4f90965998" released by "delete_volume" :: held 0.874s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['e92d4b2a-1ae2-40c0-a026-0d4a379f61fb', '28de595d-364a-49a6-b3b5-a6a6139e5702', '4476636c-5dae-4320-b669-2e987e306f69', 'cb510fae-137b-4725-9cc9-d83a69ba72c7'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:05 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:05 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (c992602a-029b-4081-b477-8654aa968025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf6953e-a7ed-4c1f-87ee-45546c258aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf6953e-a7ed-4c1f-87ee-45546c258aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471792182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4ce429-b001-407a-b2bf-fd58618e0e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:06Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28636e1b-c443-4c3c-94cc-38fb7f4c5a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28636e1b-c443-4c3c-94cc-38fb7f4c5a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:05 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ee9c00-be7a-4596-99a1-1d83581b9143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ee9c00-be7a-4596-99a1-1d83581b9143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4ce429-b001-407a-b2bf-fd58618e0e15', 'volume_name': 'volume-4e4ce429-b001-407a-b2bf-fd58618e0e15', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0481e199-34b7-4473-948d-799c0388c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0481e199-34b7-4473-948d-799c0388c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7553e495-aee5-4fc9-a8d4-c72560e872ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume 4e4ce429-b001-407a-b2bf-fd58618e0e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4ce429-b001-407a-b2bf-fd58618e0e15', 'volume_size': 1}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-471792182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4ce429-b001-407a-b2bf-fd58618e0e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:06Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Creating volume 4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:26:05 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.468s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleted volume successfully.
Apr 13 11:26:05 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 1073741824
Apr 13 11:26:05 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2f90d7c7-5244-4a9f-8115-b60e618b86f7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-9c0c833e-48fb-4035-a187-0e4f90965998-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:06 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 1073741824" returned: 0 in 0.461s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:06 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:06 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:06 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.432s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7553e495-aee5-4fc9-a8d4-c72560e872ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4ce429-b001-407a-b2bf-fd58618e0e15', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8182650a-81f3-4760-8871-ee82dd14fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:06 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Volume volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 (4e4ce429-b001-407a-b2bf-fd58618e0e15): created successfully
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8182650a-81f3-4760-8871-ee82dd14fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (c992602a-029b-4081-b477-8654aa968025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:06 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ce0e6cd8-2e5c-47d6-bb93-60f59f02afa6 tempest-VolumesSnapshotTestJSON-1424988278 None] Created volume successfully.
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Creating offline snapshot 6dfdc5d4-d966-463f-bd24-059a482bde4d of volume 4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d2976a-9fe9-4a36-a76b-49e6f2a4ce7f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:08 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:08 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:08 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.444s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:08 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d 1G
Apr 13 11:26:08 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:08 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d 1G" returned: 0 in 0.445s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:08 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d
Apr 13 11:26:08 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:09 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d" returned: 0 in 0.410s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:09 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d is being set with open permissions: ugo+rw
Apr 13 11:26:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:09 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d
Apr 13 11:26:09 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:09 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d" returned: 0 in 0.383s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:09 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info
Apr 13 11:26:09 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:10 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info" returned: 0 in 0.401s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:10 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info is being set with open permissions: ugo+rw
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:10 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info
Apr 13 11:26:10 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:10 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.info" returned: 0 in 0.413s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.553s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:10 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3895acd7-21f8-4fe0-8c13-4fc118b16f15 tempest-VolumesSnapshotTestJSON-1424988278 None] Create snapshot completed successfully
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:10 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:10 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:11 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.394s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (122707eb-158d-41a2-a1e1-697c37d2afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27d858d-b0cc-4943-b2d6-769eb95a942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27d858d-b0cc-4943-b2d6-769eb95a942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1222470341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd07473d-a90e-4422-9d0f-2a6628ae3f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c3dfd284244fda3c7f0d2eb7859b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6dfdc5d4-d966-463f-bd24-059a482bde4d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:11Z,use_quota=True,user_id='2fe6c53d615d4848836208e200f23f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc92af6-b844-4220-8d11-534d3f6b170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc92af6-b844-4220-8d11-534d3f6b170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717b926f-29c0-4baf-94ee-34c92f868adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717b926f-29c0-4baf-94ee-34c92f868adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd07473d-a90e-4422-9d0f-2a6628ae3f9e', 'volume_name': 'volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e', 'volume_size': 1, 'snapshot_id': '6dfdc5d4-d966-463f-bd24-059a482bde4d'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00fd07d-d26c-476a-89be-5d8b622957a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00fd07d-d26c-476a-89be-5d8b622957a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c571e8c-ac79-4a76-9217-08e5a4577975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Volume fd07473d-a90e-4422-9d0f-2a6628ae3f9e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e', 'volume_size': 1, 'snapshot_id': '6dfdc5d4-d966-463f-bd24-059a482bde4d'}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-6dfdc5d4-d966-463f-bd24-059a482bde4d-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6dfdc5d4-d966-463f-bd24-059a482bde4d-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Creating volume fd07473d-a90e-4422-9d0f-2a6628ae3f9e from snapshot 6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] snapshot: 6dfdc5d4-d966-463f-bd24-059a482bde4d, volume: fd07473d-a90e-4422-9d0f-2a6628ae3f9e,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b20abd-7c8e-4e52-8f54-c97dc6d9a5ca]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:11 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d
Apr 13 11:26:11 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:12 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d" returned: 0 in 0.482s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4ce429-b001-407a-b2bf-fd58618e0e15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c25f3b-ed0a-4ebb-a74a-5a5c7427db41]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:12 devstack sudo[89386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:12 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:12 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:26:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:12 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e
Apr 13 11:26:12 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:14 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" returned: 0 in 2.012s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:14 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0aac1e-9241-4be9-bbf4-1a68dbe330b3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:14 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:14 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:15 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.590s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15, size 1024.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:26:15 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Converted 1024.00 MB image at 508.48 MB/s
Apr 13 11:26:15 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e is being set with open permissions: ugo+rw
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:15 devstack sudo[89408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e
Apr 13 11:26:15 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:15 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" returned: 0 in 0.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" released by "_copy_volume_from_snapshot" :: held 4.061s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6dfdc5d4-d966-463f-bd24-059a482bde4d-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" released by "_create_volume_from_snapshot" :: held 4.077s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.086s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c571e8c-ac79-4a76-9217-08e5a4577975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e', 'volume_size': 1, 'snapshot_id': '6dfdc5d4-d966-463f-bd24-059a482bde4d'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0e2a46-678c-41f9-9b61-2e2d07e30c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:15 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Volume volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e (fd07473d-a90e-4422-9d0f-2a6628ae3f9e): created successfully
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0e2a46-678c-41f9-9b61-2e2d07e30c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Flow 'volume_create_manager' (122707eb-158d-41a2-a1e1-697c37d2afdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:15 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-590aa7fc-39ec-4d07-8898-41a96232dcfb tempest-VolumesSnapshotTestJSON-1424988278 None] Created volume successfully.
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-fd07473d-a90e-4422-9d0f-2a6628ae3f9e-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-fd07473d-a90e-4422-9d0f-2a6628ae3f9e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d20398f-f3ea-4d92-8c84-a332794d5192]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:15 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e
Apr 13 11:26:15 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:16 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" returned: 0 in 0.484s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:16 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e
Apr 13 11:26:16 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:16 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" returned: 0 in 0.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-fd07473d-a90e-4422-9d0f-2a6628ae3f9e" released by "delete_volume" :: held 0.947s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['9cc832b7-5d98-4b92-a1a2-11a7e88d980f', '32509e4a-0f62-457c-a54c-e2094b50fa01', '0f9ca7ec-c0f8-4338-87f8-3f998d04a861', '36688665-f314-43af-a22f-17e549b71bf6'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:16 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:16 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-6dfdc5d4-d966-463f-bd24-059a482bde4d-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-6dfdc5d4-d966-463f-bd24-059a482bde4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:16 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-4e4ce429-b001-407a-b2bf-fd58618e0e15" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-4e4ce429-b001-407a-b2bf-fd58618e0e15" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-6dfdc5d4-d966-463f-bd24-059a482bde4d" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6dfdc5d4-d966-463f-bd24-059a482bde4d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleting offline snapshot 6dfdc5d4-d966-463f-bd24-059a482bde4d of volume 4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] snapshot_file for this snap is: volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec4e3c-7fe8-46ef-a44f-afc4aa73ab1c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:17 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d
Apr 13 11:26:17 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:17 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.461s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:17 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleted volume successfully.
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-81f452d1-ce23-407d-af50-299e17190178 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-fd07473d-a90e-4422-9d0f-2a6628ae3f9e-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:17 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d" returned: 0 in 0.472s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4ce429-b001-407a-b2bf-fd58618e0e15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[93042660-b673-4a26-b63d-fb209e3fcbb8]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:17 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:17 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:17 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:17 devstack sudo[89467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d
Apr 13 11:26:17 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:18 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d" returned: 0 in 0.431s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:18 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d
Apr 13 11:26:18 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:18 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15.6dfdc5d4-d966-463f-bd24-059a482bde4d" returned: 0 in 0.387s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-6dfdc5d4-d966-463f-bd24-059a482bde4d" released by "_delete_snapshot" :: held 1.805s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-4e4ce429-b001-407a-b2bf-fd58618e0e15" released by "delete_snapshot" :: held 1.820s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['0410004c-cd3c-407b-a771-cd627516fb9c', '53331294-f388-4995-b30b-96136c9a7db0', '50cc3fed-c480-488d-afd9-9ba428fa6fab', '560f41ff-526f-4658-8d21-66e361071775'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Delete snapshot completed successfully.
Apr 13 11:26:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-cb632fd7-10f1-4b3f-935b-dfc9ba3802b7 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-6dfdc5d4-d966-463f-bd24-059a482bde4d-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-4e4ce429-b001-407a-b2bf-fd58618e0e15-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-4e4ce429-b001-407a-b2bf-fd58618e0e15-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-4e4ce429-b001-407a-b2bf-fd58618e0e15" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-4e4ce429-b001-407a-b2bf-fd58618e0e15" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b544a8-45ce-4434-a474-63cd79c48e61]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:19 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:19 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:19 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.462s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:19 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15
Apr 13 11:26:19 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:20 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4e4ce429-b001-407a-b2bf-fd58618e0e15" returned: 0 in 0.405s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-4e4ce429-b001-407a-b2bf-fd58618e0e15" released by "delete_volume" :: held 0.894s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['edf17f51-4140-45fc-8e25-cae04a8dbf75', '42c0dc59-6849-44e2-adc0-6b176454628e', '99f105fe-abf5-4a9c-b2d6-febad176222e', '09bd95d4-c130-40e8-9f17-04b1512f3989'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:20 devstack sudo[89483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:20 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-f7d959e6-f13a-497a-bd7d-22140de9e04f-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-f7d959e6-f13a-497a-bd7d-22140de9e04f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "cinder-quobyte-f7d959e6-f13a-497a-bd7d-22140de9e04f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-f7d959e6-f13a-497a-bd7d-22140de9e04f" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01ea4a0-03db-4a24-933d-4f3943260bd0]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:20 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f
Apr 13 11:26:20 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:20 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.437s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleted volume successfully.
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bcb9109d-82b2-437e-912d-6a57ef55b751 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-4e4ce429-b001-407a-b2bf-fd58618e0e15-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:20 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f" returned: 0 in 0.483s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:20 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f
Apr 13 11:26:20 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:21 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f7d959e6-f13a-497a-bd7d-22140de9e04f" returned: 0 in 0.396s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-quobyte-f7d959e6-f13a-497a-bd7d-22140de9e04f" released by "delete_volume" :: held 0.910s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Created reservations ['2088f0cd-7dca-4551-9041-5f46ba3a039a', 'dc4473dd-a032-4df4-9d5b-f9ed06db1a3e', '0e3a198f-2f4e-45f0-8fda-10bc3c4a6158', '7a650046-acbb-4b09-94c8-e1929902121c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:21 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:21 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:21 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.432s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:21 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Deleted volume successfully.
Apr 13 11:26:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-673c4f2e-0db4-4cff-a7bb-37a3d5041a63 tempest-VolumesSnapshotTestJSON-1424988278 None] Lock "cinder-f7d959e6-f13a-497a-bd7d-22140de9e04f-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=106,cinder:UPDATE=92,cinder:INSERT=35,cinder:DELETE=7 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=106,cinder:SELECT=76,cinder:INSERT=26,cinder:DELETE=10 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (688233d0-1484-4ae4-b9cb-4bab8ea33150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce37e59-26d4-423c-95b2-fb0667fadf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce37e59-26d4-423c-95b2-fb0667fadf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-786845259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4045b7-b30c-4a16-bac7-76fa39795f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685eba55370c4f62aa14ae37b1437a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:25Z,use_quota=True,user_id='8692b422228341d3afbf8ded8f5f67ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36cb9ef-5fcd-40fc-aa07-f0b9da3a39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36cb9ef-5fcd-40fc-aa07-f0b9da3a39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb91dee5-3fea-480b-8f82-696e3793375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb91dee5-3fea-480b-8f82-696e3793375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4045b7-b30c-4a16-bac7-76fa39795f84', 'volume_name': 'volume-ab4045b7-b30c-4a16-bac7-76fa39795f84', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a64c539-36de-44ff-b6b9-c5f6d5f81f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a64c539-36de-44ff-b6b9-c5f6d5f81f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fac0af-eae0-40fd-83be-9f1e5e7de687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:25 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Volume ab4045b7-b30c-4a16-bac7-76fa39795f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4045b7-b30c-4a16-bac7-76fa39795f84', 'volume_size': 1}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-786845259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4045b7-b30c-4a16-bac7-76fa39795f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685eba55370c4f62aa14ae37b1437a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:25Z,use_quota=True,user_id='8692b422228341d3afbf8ded8f5f67ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Creating volume ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:26:25 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:25 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 1073741824
Apr 13 11:26:25 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:25 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 1073741824" returned: 0 in 0.477s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:25 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:25 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:26 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.409s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fac0af-eae0-40fd-83be-9f1e5e7de687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4045b7-b30c-4a16-bac7-76fa39795f84', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caae300b-de61-4e6b-8f3a-b8d4af272967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:26 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Volume volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 (ab4045b7-b30c-4a16-bac7-76fa39795f84): created successfully
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caae300b-de61-4e6b-8f3a-b8d4af272967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (688233d0-1484-4ae4-b9cb-4bab8ea33150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:26 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3bbb86e7-96b3-4b0d-a1dc-0dd93239e041 tempest-VolumeDependencyTests-506244029 None] Created volume successfully.
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Creating offline snapshot 3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 of volume ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a545d4e-8ca5-4ed1-a763-f7c81ed85a3f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:27 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:27 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:27 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:27 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 1G
Apr 13 11:26:27 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:28 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 1G" returned: 0 in 0.506s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:28 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18
Apr 13 11:26:28 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:28 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" returned: 0 in 0.433s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:28 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 is being set with open permissions: ugo+rw
Apr 13 11:26:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:28 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18
Apr 13 11:26:28 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:29 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" returned: 0 in 0.401s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:29 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info
Apr 13 11:26:29 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:29 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info" returned: 0 in 0.445s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:29 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info is being set with open permissions: ugo+rw
Apr 13 11:26:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:29 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info
Apr 13 11:26:29 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:30 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.info" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-24e9e45c-1b88-46fb-a561-44626988d5a2 tempest-VolumeDependencyTests-506244029 None] Create snapshot completed successfully
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (54e2a4d2-ede8-4571-9fbc-ce7da51fb76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e88eb47-b02b-46b6-827e-d64a86e9e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e88eb47-b02b-46b6-827e-d64a86e9e30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1876773583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cb9605-4f3f-4594-bdd4-e6348eeca1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685eba55370c4f62aa14ae37b1437a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d914fa8-57a9-41d4-b705-bf5e5ea0bb18,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:31Z,use_quota=True,user_id='8692b422228341d3afbf8ded8f5f67ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361e6386-4fc7-4972-8aed-1bed13dee8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361e6386-4fc7-4972-8aed-1bed13dee8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e498211-ec4d-4fd3-9f4d-3d05d86223f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e498211-ec4d-4fd3-9f4d-3d05d86223f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16cb9605-4f3f-4594-bdd4-e6348eeca1d4', 'volume_name': 'volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4', 'volume_size': 1, 'snapshot_id': '3d914fa8-57a9-41d4-b705-bf5e5ea0bb18'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f989550-e5dd-4c9c-88db-244a68b61847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f989550-e5dd-4c9c-88db-244a68b61847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3e4d2b-2ae4-4e65-bbf4-579701c7b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Volume 16cb9605-4f3f-4594-bdd4-e6348eeca1d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4', 'volume_size': 1, 'snapshot_id': '3d914fa8-57a9-41d4-b705-bf5e5ea0bb18'}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Creating volume 16cb9605-4f3f-4594-bdd4-e6348eeca1d4 from snapshot 3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] snapshot: 3d914fa8-57a9-41d4-b705-bf5e5ea0bb18, volume: 16cb9605-4f3f-4594-bdd4-e6348eeca1d4,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db718b-3794-4d02-949f-738345d2d416]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:30 devstack sudo[89534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18
Apr 13 11:26:30 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:31 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" returned: 0 in 0.486s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4045b7-b30c-4a16-bac7-76fa39795f84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5beb92-738b-4e0f-bb9e-1cbb41998957]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:31 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:31 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:31 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:26:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:31 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4
Apr 13 11:26:31 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:33 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" returned: 0 in 1.992s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:33 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27def46-f018-4274-b1fe-2c910514f0d5]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:33 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:33 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:34 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.605s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:26:34 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Converted 1024.00 MB image at 513.64 MB/s
Apr 13 11:26:34 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 is being set with open permissions: ugo+rw
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:34 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4
Apr 13 11:26:34 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:34 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" returned: 0 in 0.403s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" released by "_copy_volume_from_snapshot" :: held 4.008s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" released by "_create_volume_from_snapshot" :: held 4.023s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.030s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3e4d2b-2ae4-4e65-bbf4-579701c7b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4', 'volume_size': 1, 'snapshot_id': '3d914fa8-57a9-41d4-b705-bf5e5ea0bb18'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b9791-0d50-41ae-b459-433ac5a3f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Volume volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 (16cb9605-4f3f-4594-bdd4-e6348eeca1d4): created successfully
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b9791-0d50-41ae-b459-433ac5a3f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (54e2a4d2-ede8-4571-9fbc-ce7da51fb76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-79d57c25-a2bd-4161-86ed-dd6247ae04f7 tempest-VolumeDependencyTests-506244029 None] Created volume successfully.
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Lock "cinder-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-ab4045b7-b30c-4a16-bac7-76fa39795f84" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-ab4045b7-b30c-4a16-bac7-76fa39795f84" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Deleting offline snapshot 3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 of volume ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] snapshot_file for this snap is: volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6992ea6d-b46a-4f2b-b1bd-d8a681e8524f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:35 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18
Apr 13 11:26:35 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:35 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" returned: 0 in 0.504s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4045b7-b30c-4a16-bac7-76fa39795f84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[15935002-d3e8-4930-ad6b-f8129274dfe6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:35 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:35 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:35 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.482s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:36 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18
Apr 13 11:26:36 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:36 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" returned: 0 in 0.455s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:36 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18
Apr 13 11:26:36 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:36 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84.3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" returned: 0 in 0.429s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18" released by "_delete_snapshot" :: held 1.921s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-ab4045b7-b30c-4a16-bac7-76fa39795f84" released by "delete_snapshot" :: held 1.932s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Created reservations ['1b66c78e-7e84-4c65-a53d-3d40e91e74de', 'e82e293f-303b-42fe-9a3c-abc7931fc534', '5239365e-f12e-4fb8-b6d9-7b9842744722', 'a4dd8c27-5c7c-4bca-b412-7694b8fe8a8d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Delete snapshot completed successfully.
Apr 13 11:26:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-09b7630a-d1db-471a-9288-918ac6ebd46c tempest-VolumeDependencyTests-506244029 None] Lock "cinder-3d914fa8-57a9-41d4-b705-bf5e5ea0bb18-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-ab4045b7-b30c-4a16-bac7-76fa39795f84-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-ab4045b7-b30c-4a16-bac7-76fa39795f84-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-ab4045b7-b30c-4a16-bac7-76fa39795f84" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-ab4045b7-b30c-4a16-bac7-76fa39795f84" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8351fc5c-7508-4017-b30f-387bc124aab1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:37 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:37 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:37 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.505s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:37 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84
Apr 13 11:26:37 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:38 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ab4045b7-b30c-4a16-bac7-76fa39795f84" returned: 0 in 0.457s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-ab4045b7-b30c-4a16-bac7-76fa39795f84" released by "delete_volume" :: held 1.001s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Created reservations ['fd2d2fb8-9283-4e91-a7e0-9a4f9c36a77b', 'b7c4c6f3-a347-480b-bcce-7152a653defd', '74d40259-3b45-415c-af64-4dd80921c714', '3baeaefb-bfd9-44dd-b3a7-597872f3f2ac'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:38 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:38 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:38 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.441s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Deleted volume successfully.
Apr 13 11:26:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-27f68470-7e64-4de8-9627-bcadca6ad4d3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-ab4045b7-b30c-4a16-bac7-76fa39795f84-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (a8603667-5d4a-4bc4-89e0-812221cd524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04bd9df-f343-4f66-9c11-c15b1a2c3133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04bd9df-f343-4f66-9c11-c15b1a2c3133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-760909165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4026c7c9-23e1-40eb-b9a6-139f7e622dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685eba55370c4f62aa14ae37b1437a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:39Z,use_quota=True,user_id='8692b422228341d3afbf8ded8f5f67ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b31984-2644-4488-8a09-abff6458b82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b31984-2644-4488-8a09-abff6458b82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcbbc25-1887-4025-b338-66fe881be121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fcbbc25-1887-4025-b338-66fe881be121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'volume_name': 'volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607e4328-819c-4c73-a42e-50f4dd610a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607e4328-819c-4c73-a42e-50f4dd610a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37f1758-ddfc-4443-8d30-55b0d226b994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:39 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Volume 4026c7c9-23e1-40eb-b9a6-139f7e622dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'volume_size': 1}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-760909165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4026c7c9-23e1-40eb-b9a6-139f7e622dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685eba55370c4f62aa14ae37b1437a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:39Z,use_quota=True,user_id='8692b422228341d3afbf8ded8f5f67ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Creating volume 4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:26:39 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:26:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:39 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 1073741824
Apr 13 11:26:39 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:40 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 1073741824" returned: 0 in 0.535s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:40 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:40 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:40 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.486s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37f1758-ddfc-4443-8d30-55b0d226b994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0e71b0-45d7-41fb-8824-e8508ffe3be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Volume volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 (4026c7c9-23e1-40eb-b9a6-139f7e622dc7): created successfully
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0e71b0-45d7-41fb-8824-e8508ffe3be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (a8603667-5d4a-4bc4-89e0-812221cd524a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-3ad4c7e3-e548-4057-8141-e0b85c276d31 tempest-VolumeDependencyTests-506244029 None] Created volume successfully.
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (e914a667-0f05-4251-b030-786d58a66e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4ff710-9fe6-4a5b-b908-b36b8917a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4ff710-9fe6-4a5b-b908-b36b8917a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-193511885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714b3678-4887-48b1-8164-654c31d71b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685eba55370c4f62aa14ae37b1437a45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=4026c7c9-23e1-40eb-b9a6-139f7e622dc7,status='creating',terminated_at=None,updated_at=2026-04-13T09:26:42Z,use_quota=True,user_id='8692b422228341d3afbf8ded8f5f67ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8233de-b54f-45c6-ad6b-581918cf31e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8233de-b54f-45c6-ad6b-581918cf31e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed047f4-99ff-4308-a839-90a6254e2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed047f4-99ff-4308-a839-90a6254e2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '714b3678-4887-48b1-8164-654c31d71b94', 'volume_name': 'volume-714b3678-4887-48b1-8164-654c31d71b94', 'volume_size': 1, 'source_volid': '4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f72734-dcee-4660-b4e2-a2f3f7c81f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f72734-dcee-4660-b4e2-a2f3f7c81f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4075b037-b5ef-42a7-b98e-ad9791120519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:41 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Volume 714b3678-4887-48b1-8164-654c31d71b94: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-714b3678-4887-48b1-8164-654c31d71b94', 'volume_size': 1, 'source_volid': '4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'source_volstatus': 'available'}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:41 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Cloning volume 4026c7c9-23e1-40eb-b9a6-139f7e622dc7 to volume 714b3678-4887-48b1-8164-654c31d71b94
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Creating offline snapshot 7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 of volume 4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[29159dfc-f632-49b1-8301-f784fed4be09]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:42 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:42 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:42 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:42 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 1G
Apr 13 11:26:42 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:42 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 1G" returned: 0 in 0.518s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:43 devstack sudo[89614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5
Apr 13 11:26:43 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:43 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" returned: 0 in 0.436s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:43 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 is being set with open permissions: ugo+rw
Apr 13 11:26:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:43 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5
Apr 13 11:26:43 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:43 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" returned: 0 in 0.417s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:43 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info
Apr 13 11:26:43 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:44 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info" returned: 0 in 0.415s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:44 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info is being set with open permissions: ugo+rw
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:44 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info
Apr 13 11:26:44 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:44 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.info" returned: 0 in 0.432s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-714b3678-4887-48b1-8164-654c31d71b94" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-714b3678-4887-48b1-8164-654c31d71b94" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] snapshot: 7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5, volume: 714b3678-4887-48b1-8164-654c31d71b94,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e23550-63b2-4701-9b20-786069325e20]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:44 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5
Apr 13 11:26:44 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:45 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" returned: 0 in 0.472s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[b792b9a6-2829-4251-97ff-341d6b06ab3f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:45 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:45 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:45 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.491s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:26:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:45 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94
Apr 13 11:26:45 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:47 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94" returned: 0 in 2.040s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:47 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b27e8-ddb2-4243-abd3-96304c22fb28]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:47 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:47 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:48 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.612s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:26:48 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Converted 1024.00 MB image at 501.64 MB/s
Apr 13 11:26:48 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 is being set with open permissions: ugo+rw
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:48 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94
Apr 13 11:26:48 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:48 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94" returned: 0 in 0.407s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-714b3678-4887-48b1-8164-654c31d71b94" released by "_copy_volume_from_snapshot" :: held 4.070s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Deleting offline snapshot 7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 of volume 4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] snapshot_file for this snap is: volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3ead1-5643-4d30-a84b-394b10e4893b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:48 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5
Apr 13 11:26:48 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:49 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" returned: 0 in 0.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:26:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5302fe-3858-4f42-87ef-fecab62ec48d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:49 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:49 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:49 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.491s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:49 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5
Apr 13 11:26:49 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:50 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" returned: 0 in 0.475s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:50 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5
Apr 13 11:26:50 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:50 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7.7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-7232cf06-e20c-4dfd-bde7-8ef7e31f2bc5" released by "_delete_snapshot" :: held 1.985s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.885s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4075b037-b5ef-42a7-b98e-ad9791120519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714b3678-4887-48b1-8164-654c31d71b94', 'volume_size': 1, 'source_volid': '4026c7c9-23e1-40eb-b9a6-139f7e622dc7', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366f7c60-48d7-415f-ae8a-179b01e13220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:26:50 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Volume volume-714b3678-4887-48b1-8164-654c31d71b94 (714b3678-4887-48b1-8164-654c31d71b94): created successfully
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366f7c60-48d7-415f-ae8a-179b01e13220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:26:50 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Flow 'volume_create_manager' (e914a667-0f05-4251-b030-786d58a66e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:26:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7f7206df-9f86-4554-b93d-8d932c3c9f18 tempest-VolumeDependencyTests-506244029 None] Created volume successfully.
Apr 13 11:26:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-4026c7c9-23e1-40eb-b9a6-139f7e622dc7-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-4026c7c9-23e1-40eb-b9a6-139f7e622dc7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:51 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ea4af-df27-4f6b-8178-6a4980059500]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:51 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:51 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:52 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.538s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:52 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7
Apr 13 11:26:52 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:52 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" returned: 0 in 0.426s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-4026c7c9-23e1-40eb-b9a6-139f7e622dc7" released by "delete_volume" :: held 0.999s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Created reservations ['8998f368-e96f-4c71-bd6a-323a29f5fa56', '8fe7df35-cfe8-46ac-8607-49a0fc93c91b', 'fd7240c1-0fa0-476f-9474-33648bc02c9f', '45f6dda4-171b-469b-bc85-737267cdfd07'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:52 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:52 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:52 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.417s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:52 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Deleted volume successfully.
Apr 13 11:26:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-329b59e7-84ac-4739-9f2e-96d0ae529dd3 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-4026c7c9-23e1-40eb-b9a6-139f7e622dc7-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-714b3678-4887-48b1-8164-654c31d71b94-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-714b3678-4887-48b1-8164-654c31d71b94-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-714b3678-4887-48b1-8164-654c31d71b94" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:53 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-714b3678-4887-48b1-8164-654c31d71b94" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:53 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0c83b-bc1e-4b4b-ab20-2c2df6c1a7c8]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:53 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94
Apr 13 11:26:53 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:54 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94" returned: 0 in 0.503s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:54 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94
Apr 13 11:26:54 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:54 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-714b3678-4887-48b1-8164-654c31d71b94" returned: 0 in 0.437s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-714b3678-4887-48b1-8164-654c31d71b94" released by "delete_volume" :: held 0.966s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Created reservations ['a041fdab-93f9-4683-9acf-09eea8cdde19', '0ee24759-079a-42ef-8829-c44cc1a836b1', 'c2acda8d-a70e-4d5a-af9f-a0fa97943b16', 'fe1d5664-4f38-4625-b44f-a636422db134'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:54 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:54 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-16cb9605-4f3f-4594-bdd4-e6348eeca1d4-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-16cb9605-4f3f-4594-bdd4-e6348eeca1d4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "cinder-quobyte-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4ed56-10f3-4c9f-b73b-d4f17b03a257]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:26:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:54 devstack sudo[89699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4
Apr 13 11:26:54 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:55 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:55 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Deleted volume successfully.
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-76a9f0f9-d294-446f-a835-97f9905b6cd2 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-714b3678-4887-48b1-8164-654c31d71b94-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:55 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" returned: 0 in 0.505s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:55 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4
Apr 13 11:26:55 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:55 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" returned: 0 in 0.479s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-quobyte-16cb9605-4f3f-4594-bdd4-e6348eeca1d4" released by "delete_volume" :: held 1.008s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Created reservations ['d13b29fd-4007-4e8d-bc0c-001a554ca62d', 'c7f2ae25-3ee3-41bf-9439-9a70d44ce0f6', 'c3a61933-155c-4d2d-aedd-2456baa44e70', '6e7add78-e8be-4baa-a496-7f7f2545c8d0'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:26:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:26:56 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:26:56 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:26:56 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 13 11:26:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:26:56 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:26:56 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Deleted volume successfully.
Apr 13 11:26:56 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-174704c1-fb1b-4b63-8eb9-0f296d26d750 tempest-VolumeDependencyTests-506244029 None] Lock "cinder-16cb9605-4f3f-4594-bdd4-e6348eeca1d4-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (54accd91-1560-4a8d-8725-42b7eeeada69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ab5fe9-131a-4665-9c0e-5e267d9a1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ab5fe9-131a-4665-9c0e-5e267d9a1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240127280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24ba605-9c48-49b0-abcb-e4cf8016aca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:04Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444a164f-d7b2-4ae7-aa39-c7610f496433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444a164f-d7b2-4ae7-aa39-c7610f496433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b372c1-415f-4f6b-b135-a3c0ab799eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b372c1-415f-4f6b-b135-a3c0ab799eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24ba605-9c48-49b0-abcb-e4cf8016aca2', 'volume_name': 'volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316eac99-11e1-4cc3-95bf-176ea027e753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316eac99-11e1-4cc3-95bf-176ea027e753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6b9642-5e4e-4bc1-bb91-00057d8edd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Volume b24ba605-9c48-49b0-abcb-e4cf8016aca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2', 'volume_size': 1}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240127280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24ba605-9c48-49b0-abcb-e4cf8016aca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:04Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Creating volume b24ba605-9c48-49b0-abcb-e4cf8016aca2 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:04 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:04 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 1073741824
Apr 13 11:27:04 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (8527bad0-cb2e-4b5b-801d-5d8f0adbcdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533aa2f5-0e53-4424-957f-106f9dd5209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533aa2f5-0e53-4424-957f-106f9dd5209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967958992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27989c68-91d6-478d-b8fe-f5e477810d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf2453a-b01a-4dc4-a455-6dc395495ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf2453a-b01a-4dc4-a455-6dc395495ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee693e3-e088-4e0b-8309-04abd83c9249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee693e3-e088-4e0b-8309-04abd83c9249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27989c68-91d6-478d-b8fe-f5e477810d44', 'volume_name': 'volume-27989c68-91d6-478d-b8fe-f5e477810d44', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2e4f60-9ada-4053-b3b2-d3af8fd2794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2e4f60-9ada-4053-b3b2-d3af8fd2794f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955cff93-e9f7-4ed0-857e-0daa9cdba398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume 27989c68-91d6-478d-b8fe-f5e477810d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27989c68-91d6-478d-b8fe-f5e477810d44', 'volume_size': 1}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (0eb3cc8c-4ed2-433a-9437-67dd78250896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d349da2d-b486-4eb1-a09a-d8bdd34d2d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d349da2d-b486-4eb1-a09a-d8bdd34d2d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299867321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516bcb29-784b-4dbe-89ae-8919499c6640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76b9054-1bc9-4907-bce7-e2742d12cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76b9054-1bc9-4907-bce7-e2742d12cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f67f9f-8e86-4f9b-81b5-7bee3891d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f67f9f-8e86-4f9b-81b5-7bee3891d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516bcb29-784b-4dbe-89ae-8919499c6640', 'volume_name': 'volume-516bcb29-784b-4dbe-89ae-8919499c6640', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552fb462-aacf-4c97-b48e-2b6dd23c9861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552fb462-aacf-4c97-b48e-2b6dd23c9861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d44463-1a65-46c7-8684-6ddbb077e757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:04 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Volume 516bcb29-784b-4dbe-89ae-8919499c6640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516bcb29-784b-4dbe-89ae-8919499c6640', 'volume_size': 1}
Apr 13 11:27:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (90968331-2f5b-470d-997c-c2ab0bdef5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c998b481-9590-466c-92cf-5bea5fbb8ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c998b481-9590-466c-92cf-5bea5fbb8ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1976554002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce54602-a1c1-490d-a54b-6b71be381c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146b15f2da9b439582d00d94fba45ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='73418b7e5e3843dea308f4089dcaed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0639f8-b905-4159-840b-15cab5a9f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0639f8-b905-4159-840b-15cab5a9f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21105dd-3f79-40b6-ad76-902df9cb353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21105dd-3f79-40b6-ad76-902df9cb353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce54602-a1c1-490d-a54b-6b71be381c35', 'volume_name': 'volume-bce54602-a1c1-490d-a54b-6b71be381c35', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c5a661-bd04-48dc-80e0-b2c43fb42dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c5a661-bd04-48dc-80e0-b2c43fb42dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f67d338-b24c-4d1d-928c-1a14dac28cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Volume bce54602-a1c1-490d-a54b-6b71be381c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce54602-a1c1-490d-a54b-6b71be381c35', 'volume_size': 1}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (5502ef37-6aea-4e28-9cd3-634d22b78a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112cd981-de6a-4bfe-bae7-0582152619e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112cd981-de6a-4bfe-bae7-0582152619e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750670996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb40b083-8c7f-4f20-86ec-265d20dd6666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ff6a39-0315-4ecc-9bc8-492410f215f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ff6a39-0315-4ecc-9bc8-492410f215f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecbae84-eda9-4363-b14a-764d9088d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecbae84-eda9-4363-b14a-764d9088d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb40b083-8c7f-4f20-86ec-265d20dd6666', 'volume_name': 'volume-eb40b083-8c7f-4f20-86ec-265d20dd6666', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d13c88-0852-4543-b4a7-e219ad6a6279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d13c88-0852-4543-b4a7-e219ad6a6279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72eef20-260e-4c0c-9725-05793a4a91be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Volume eb40b083-8c7f-4f20-86ec-265d20dd6666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb40b083-8c7f-4f20-86ec-265d20dd6666', 'volume_size': 1}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:05 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 1073741824" returned: 0 in 0.649s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:05 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2
Apr 13 11:27:05 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (4cde7e95-7d1b-4a94-95bf-6cc822affd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006d4c04-2f33-4049-9646-0c606a9ea190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006d4c04-2f33-4049-9646-0c606a9ea190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172844994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efd310f-0dd4-4de4-b55f-c085f16ae924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c08c8db-2400-4edd-b935-679b0f02112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c08c8db-2400-4edd-b935-679b0f02112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f44357d-f7c4-48f1-abf7-9eca4a6f402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f44357d-f7c4-48f1-abf7-9eca4a6f402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efd310f-0dd4-4de4-b55f-c085f16ae924', 'volume_name': 'volume-8efd310f-0dd4-4de4-b55f-c085f16ae924', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860d1e27-bfa9-4e6d-86b1-b849ef43bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860d1e27-bfa9-4e6d-86b1-b849ef43bf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5584d8a-cb54-4946-9670-f7c73f62dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Volume 8efd310f-0dd4-4de4-b55f-c085f16ae924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efd310f-0dd4-4de4-b55f-c085f16ae924', 'volume_size': 1}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (82eb5279-c969-46c4-a12a-b9308fccfad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b0a871-ed6f-4ea4-b94b-fa6aaafb992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b0a871-ed6f-4ea4-b94b-fa6aaafb992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177969405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4805c-f826-47d5-a906-b0546a6b112e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:06Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0744898-c5d4-42d1-be69-4fe3dcee45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0744898-c5d4-42d1-be69-4fe3dcee45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a51197-b030-4fca-b5a5-b16640a62a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a51197-b030-4fca-b5a5-b16640a62a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af4805c-f826-47d5-a906-b0546a6b112e', 'volume_name': 'volume-6af4805c-f826-47d5-a906-b0546a6b112e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59b9b4d-a0d2-41dd-848a-49ef5729dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59b9b4d-a0d2-41dd-848a-49ef5729dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63bd8547-75ac-43b7-af0b-28d91baa2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Volume 6af4805c-f826-47d5-a906-b0546a6b112e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af4805c-f826-47d5-a906-b0546a6b112e', 'volume_size': 1}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:05 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2" returned: 0 in 0.450s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967958992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27989c68-91d6-478d-b8fe-f5e477810d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating volume 27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:05 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 1073741824
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f6b9642-5e4e-4bc1-bb91-00057d8edd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55888eaf-fc5b-4271-bf0c-1b67a08e40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:05 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Volume volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 (b24ba605-9c48-49b0-abcb-e4cf8016aca2): created successfully
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55888eaf-fc5b-4271-bf0c-1b67a08e40cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:05 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (54accd91-1560-4a8d-8725-42b7eeeada69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2aa259f0-6bef-4a8f-a9e1-c7b9fae781a3 tempest-CreateVolumesFromImageTest-357886890 None] Created volume successfully.
Apr 13 11:27:06 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 1073741824" returned: 0 in 0.614s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:06 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44
Apr 13 11:27:06 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:06 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44" returned: 0 in 0.488s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.922s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299867321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516bcb29-784b-4dbe-89ae-8919499c6640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Creating volume 516bcb29-784b-4dbe-89ae-8919499c6640 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:06 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955cff93-e9f7-4ed0-857e-0daa9cdba398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27989c68-91d6-478d-b8fe-f5e477810d44', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba988d59-8c6b-4d99-ab73-d16045d07199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:06 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640 1073741824
Apr 13 11:27:06 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:06 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume volume-27989c68-91d6-478d-b8fe-f5e477810d44 (27989c68-91d6-478d-b8fe-f5e477810d44): created successfully
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba988d59-8c6b-4d99-ab73-d16045d07199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:06 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (8527bad0-cb2e-4b5b-801d-5d8f0adbcdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:06 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e2e209ac-0603-4f38-ab38-9e5f0b071af3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created volume successfully.
Apr 13 11:27:07 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640 1073741824" returned: 0 in 0.548s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:07 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640
Apr 13 11:27:07 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:07 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640" returned: 0 in 0.523s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1976554002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce54602-a1c1-490d-a54b-6b71be381c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146b15f2da9b439582d00d94fba45ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='73418b7e5e3843dea308f4089dcaed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Creating volume bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:07 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:08 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d44463-1a65-46c7-8684-6ddbb077e757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516bcb29-784b-4dbe-89ae-8919499c6640', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64da76c1-4c97-4de3-9760-84fee49d92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:08 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 1073741824
Apr 13 11:27:08 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:08 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Volume volume-516bcb29-784b-4dbe-89ae-8919499c6640 (516bcb29-784b-4dbe-89ae-8919499c6640): created successfully
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64da76c1-4c97-4de3-9760-84fee49d92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (0eb3cc8c-4ed2-433a-9437-67dd78250896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8c8beeaf-3ae0-40fb-87d5-1c5a8fbe75d8 tempest-CreateVolumesFromImageTest-357886890 None] Created volume successfully.
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:08 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 1073741824" returned: 0 in 0.627s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:08 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:08 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:09 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.492s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.901s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750670996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb40b083-8c7f-4f20-86ec-265d20dd6666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Creating volume eb40b083-8c7f-4f20-86ec-265d20dd6666 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:09 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f67d338-b24c-4d1d-928c-1a14dac28cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce54602-a1c1-490d-a54b-6b71be381c35', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552cb2c7-af62-4143-9ee1-9f2e58d15cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:09 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 1073741824
Apr 13 11:27:09 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:09 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Volume volume-bce54602-a1c1-490d-a54b-6b71be381c35 (bce54602-a1c1-490d-a54b-6b71be381c35): created successfully
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552cb2c7-af62-4143-9ee1-9f2e58d15cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (90968331-2f5b-470d-997c-c2ab0bdef5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-819493be-3a16-4f6b-b4f3-fe1d889137ce tempest-VolumeDependencyTests-1445316855 None] Created volume successfully.
Apr 13 11:27:09 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 1073741824" returned: 0 in 0.498s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:09 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666
Apr 13 11:27:09 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:10 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666" returned: 0 in 0.516s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.699s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172844994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efd310f-0dd4-4de4-b55f-c085f16ae924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:05Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Creating volume 8efd310f-0dd4-4de4-b55f-c085f16ae924 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:10 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72eef20-260e-4c0c-9725-05793a4a91be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb40b083-8c7f-4f20-86ec-265d20dd6666', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2712d108-4690-4d3b-b9c3-959314ca77c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:10 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Volume volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 (eb40b083-8c7f-4f20-86ec-265d20dd6666): created successfully
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2712d108-4690-4d3b-b9c3-959314ca77c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (5502ef37-6aea-4e28-9cd3-634d22b78a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:10 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 1073741824
Apr 13 11:27:10 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:10 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ad0c051a-acf2-4386-8039-c2b6447cb3dc tempest-CreateVolumesFromImageTest-357886890 None] Created volume successfully.
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:10 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:10 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:10 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 1073741824" returned: 0 in 0.576s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:10 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924
Apr 13 11:27:10 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:11 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.467s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:11 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924" returned: 0 in 0.603s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.685s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177969405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4805c-f826-47d5-a906-b0546a6b112e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184734e5e3a4442ebfa256f9556aaeda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:06Z,use_quota=True,user_id='0092461ee2ba4bb6ada00d711f0d0811',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Creating volume 6af4805c-f826-47d5-a906-b0546a6b112e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:11 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5584d8a-cb54-4946-9670-f7c73f62dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efd310f-0dd4-4de4-b55f-c085f16ae924', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac1784c-9b37-4e1d-b8b6-723988987f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:11 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e 1073741824
Apr 13 11:27:11 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:11 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Volume volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 (8efd310f-0dd4-4de4-b55f-c085f16ae924): created successfully
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac1784c-9b37-4e1d-b8b6-723988987f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:11 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (4cde7e95-7d1b-4a94-95bf-6cc822affd7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:11 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b543aa4b-55d0-4feb-aefb-1906650adef1 tempest-CreateVolumesFromImageTest-357886890 None] Created volume successfully.
Apr 13 11:27:12 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e 1073741824" returned: 0 in 0.636s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:12 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e
Apr 13 11:27:12 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:12 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e" returned: 0 in 0.578s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.558s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63bd8547-75ac-43b7-af0b-28d91baa2560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af4805c-f826-47d5-a906-b0546a6b112e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8021eea2-d9dd-4716-a888-1cbd6c3fab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating offline snapshot 481429f9-1728-4267-90f7-eb533813b561 of volume 27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:27:12 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Volume volume-6af4805c-f826-47d5-a906-b0546a6b112e (6af4805c-f826-47d5-a906-b0546a6b112e): created successfully
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8021eea2-d9dd-4716-a888-1cbd6c3fab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Flow 'volume_create_manager' (82eb5279-c969-46c4-a12a-b9308fccfad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[963f7621-4d81-46f5-a2bb-a40c8f4068c3]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:12 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:12 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-f4c26e9b-b618-440f-9aba-8236e1518b6c tempest-CreateVolumesFromImageTest-357886890 None] Created volume successfully.
Apr 13 11:27:12 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44
Apr 13 11:27:12 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:13 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44" returned: 0 in 0.596s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:13 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 1G
Apr 13 11:27:13 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-6af4805c-f826-47d5-a906-b0546a6b112e-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-6af4805c-f826-47d5-a906-b0546a6b112e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-quobyte-6af4805c-f826-47d5-a906-b0546a6b112e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-6af4805c-f826-47d5-a906-b0546a6b112e" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c981220-ff96-427c-ada1-04f671d563c1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:13 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e
Apr 13 11:27:13 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:13 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 1G" returned: 0 in 0.581s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:13 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27989c68-91d6-478d-b8fe-f5e477810d44 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:13 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27989c68-91d6-478d-b8fe-f5e477810d44 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561
Apr 13 11:27:13 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:14 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e" returned: 0 in 0.616s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:14 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e
Apr 13 11:27:14 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:14 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27989c68-91d6-478d-b8fe-f5e477810d44 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561" returned: 0 in 0.501s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:14 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 is being set with open permissions: ugo+rw
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:14 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561
Apr 13 11:27:14 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:14 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-6af4805c-f826-47d5-a906-b0546a6b112e" returned: 0 in 0.517s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-6af4805c-f826-47d5-a906-b0546a6b112e" released by "delete_volume" :: held 1.159s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Created reservations ['0d87bd6a-76e7-4c41-a7fb-e0aa6f559705', '5dbaff57-7f75-4ab8-a46f-d10d916ca7eb', '58c3e023-d2b2-4f86-98e2-eaf15402f9bd', '7a774506-47b8-4838-abde-6dc5958a155d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:14 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:14 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:14 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:14 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:14 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info
Apr 13 11:27:14 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:15 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:15 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Deleted volume successfully.
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d2555bae-d88e-489d-885e-c4aaf76b9696 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-6af4805c-f826-47d5-a906-b0546a6b112e-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:15 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info" returned: 0 in 0.500s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:15 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info is being set with open permissions: ugo+rw
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:15 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info
Apr 13 11:27:15 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-8efd310f-0dd4-4de4-b55f-c085f16ae924-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-8efd310f-0dd4-4de4-b55f-c085f16ae924-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-quobyte-8efd310f-0dd4-4de4-b55f-c085f16ae924" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-8efd310f-0dd4-4de4-b55f-c085f16ae924" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b5c4f-1090-413f-ba0d-d147e79c66fa]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:15 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:15 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924
Apr 13 11:27:15 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:16 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.info" returned: 0 in 0.767s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.552s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.926s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:16 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ace2e416-1236-41a2-a441-3c9fbd00e8a5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Create snapshot completed successfully
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Creating offline snapshot ecf99f04-c4cc-4552-ad98-89c1f8544a8b of volume bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[4633f3a2-f8ae-4551-bfdb-3ca4ac2a113f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:16 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924" returned: 0 in 0.637s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:16 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924
Apr 13 11:27:16 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:16 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:16 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:16 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:16 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (56747bc3-82e7-4750-b8a7-00cb687b7770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca7d42-cde4-4c87-8d59-15bd89fb8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-8efd310f-0dd4-4de4-b55f-c085f16ae924" returned: 0 in 0.713s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:17 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ca7d42-cde4-4c87-8d59-15bd89fb8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809311628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4c49d5-31c8-4305-9b0e-f3e2afd33169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:17Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878605c1-00b5-4726-9d59-0a76b25f9cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878605c1-00b5-4726-9d59-0a76b25f9cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231b95b0-0f86-4104-9751-7496c927e74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231b95b0-0f86-4104-9751-7496c927e74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4c49d5-31c8-4305-9b0e-f3e2afd33169', 'volume_name': 'volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667cf422-412f-4797-b8be-9a3b9118ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667cf422-412f-4797-b8be-9a3b9118ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b27766-37d4-429d-8a1e-3faad1777626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume 3d4c49d5-31c8-4305-9b0e-f3e2afd33169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169', 'volume_size': 1}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-8efd310f-0dd4-4de4-b55f-c085f16ae924" released by "delete_volume" :: held 1.466s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.848s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:17 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b 1G
Apr 13 11:27:17 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (dce2f5b1-b7c6-4570-a879-e51687c5eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a56a1e-2e0e-42e9-8a2a-f5769accd5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a56a1e-2e0e-42e9-8a2a-f5769accd5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165656286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:17Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d8599c-6a65-4f37-92c3-d13db65036f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d8599c-6a65-4f37-92c3-d13db65036f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5ae4c6-a60a-4d4a-b926-c6ae78fd1aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5ae4c6-a60a-4d4a-b926-c6ae78fd1aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb', 'volume_name': 'volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7930dd6-e554-4754-9324-55fce43257d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7930dd6-e554-4754-9324-55fce43257d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4694403-f0f7-4a47-8ada-7c1dfbe62449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume 0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb', 'volume_size': 1}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Created reservations ['e3475ac4-e697-4a07-8385-c6dc270f09c5', 'aed2ca23-cf2f-45ac-9f3e-3f73bee40b81', '9130d860-0b8e-4123-bf41-8df905532cb3', '91cb9adb-4b69-4f26-bc46-620f52ed6171'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:17 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:17 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (1299238b-ce32-42d6-92b7-af566d4250ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35d8a18-e592-4673-8d15-5a070b4bfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35d8a18-e592-4673-8d15-5a070b4bfe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877495127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8142e5-47f6-492d-9fb5-0687e63d527e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:17Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7c2f42-f59c-4ea7-aa24-07efa9cb2dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7c2f42-f59c-4ea7-aa24-07efa9cb2dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262f7bb2-7123-434c-909e-99ca1b6dd084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262f7bb2-7123-434c-909e-99ca1b6dd084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8142e5-47f6-492d-9fb5-0687e63d527e', 'volume_name': 'volume-db8142e5-47f6-492d-9fb5-0687e63d527e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4398a8ce-f37d-4fab-9c16-989fed52b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4398a8ce-f37d-4fab-9c16-989fed52b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8266766f-2227-4192-916f-ef2232d25f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume db8142e5-47f6-492d-9fb5-0687e63d527e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8142e5-47f6-492d-9fb5-0687e63d527e', 'volume_size': 1}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (dd2306d1-f852-4d27-9180-04d0c6e9179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b21a3a5-054b-4426-8e4a-95707c87c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-eb40b083-8c7f-4f20-86ec-265d20dd6666-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b 1G" returned: 0 in 0.815s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce54602-a1c1-490d-a54b-6b71be381c35 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b21a3a5-054b-4426-8e4a-95707c87c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40349479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385eeeb5-6e92-43bf-bd93-ac2506ddf378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:18Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08e30f1-668c-4726-b819-6204fb5122f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08e30f1-668c-4726-b819-6204fb5122f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e15f7bb-29ef-4da3-997b-b1894bbdb314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e15f7bb-29ef-4da3-997b-b1894bbdb314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385eeeb5-6e92-43bf-bd93-ac2506ddf378', 'volume_name': 'volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8c3dfd-eda9-4ab8-a7e6-ce5e261f4d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:17 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8c3dfd-eda9-4ab8-a7e6-ce5e261f4d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5390bf5-5a1a-4b37-a7e4-86289e99755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume 385eeeb5-6e92-43bf-bd93-ac2506ddf378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378', 'volume_size': 1}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:18 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce54602-a1c1-490d-a54b-6b71be381c35 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b
Apr 13 11:27:18 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-eb40b083-8c7f-4f20-86ec-265d20dd6666-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (69d3daa9-def1-47cd-b5c0-0e6453556b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b4f900-b9dd-4d95-bdd0-5fa14c10107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b4f900-b9dd-4d95-bdd0-5fa14c10107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492421677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf79072d-7228-4772-b927-29a07c8b7f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:18Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ac7299-a084-41be-b124-7a312415fa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ac7299-a084-41be-b124-7a312415fa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90b9e72-4a59-43cf-aa58-b1383ea0c567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90b9e72-4a59-43cf-aa58-b1383ea0c567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf79072d-7228-4772-b927-29a07c8b7f60', 'volume_name': 'volume-cf79072d-7228-4772-b927-29a07c8b7f60', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d478bbe-a760-4116-b25d-0865b46ed93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d478bbe-a760-4116-b25d-0865b46ed93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a96be6-7d5c-4212-8757-fb82ca8e4aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:18 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume cf79072d-7228-4772-b927-29a07c8b7f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf79072d-7228-4772-b927-29a07c8b7f60', 'volume_size': 1}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-quobyte-eb40b083-8c7f-4f20-86ec-265d20dd6666" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-eb40b083-8c7f-4f20-86ec-265d20dd6666" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fda64a-340b-49d1-bdd6-17382f5cb859]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:18 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.828s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:18 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Deleted volume successfully.
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-d36b7acd-43e2-455b-ad04-eaeb9dece016 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-8efd310f-0dd4-4de4-b55f-c085f16ae924-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:18 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666
Apr 13 11:27:18 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:18 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce54602-a1c1-490d-a54b-6b71be381c35 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b" returned: 0 in 0.568s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:18 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b is being set with open permissions: ugo+rw
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:18 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b
Apr 13 11:27:18 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:18 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666" returned: 0 in 0.546s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:18 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:18 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666
Apr 13 11:27:18 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:19 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b" returned: 0 in 0.521s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:19 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info
Apr 13 11:27:19 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:19 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-eb40b083-8c7f-4f20-86ec-265d20dd6666" returned: 0 in 0.512s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-eb40b083-8c7f-4f20-86ec-265d20dd6666" released by "delete_volume" :: held 1.082s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Created reservations ['61979bf9-9f7e-4141-aa7a-36c5463cac3e', '777570d6-4f5c-4b00-9ea2-0bfc896e9529', '4bf917fc-80fc-46d4-a24d-36c8964a4be1', 'eef77105-7b42-48f5-9a58-33186f16711c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:19 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:19 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:19 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:19 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info is being set with open permissions: ugo+rw
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:19 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info
Apr 13 11:27:19 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:19 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.539s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:19 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Deleted volume successfully.
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-379e79fa-6d54-4652-8d91-6fb9fba6b7a7 tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-eb40b083-8c7f-4f20-86ec-265d20dd6666-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:19 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.info" returned: 0 in 0.465s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.714s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809311628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4c49d5-31c8-4305-9b0e-f3e2afd33169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:17Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating volume 3d4c49d5-31c8-4305-9b0e-f3e2afd33169 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:19 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:19 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:20 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 1073741824
Apr 13 11:27:20 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:20 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c0bdb69e-5439-4d4e-86dc-41fef95008ce tempest-VolumeDependencyTests-1445316855 None] Create snapshot completed successfully
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-516bcb29-784b-4dbe-89ae-8919499c6640-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-516bcb29-784b-4dbe-89ae-8919499c6640-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-quobyte-516bcb29-784b-4dbe-89ae-8919499c6640" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-516bcb29-784b-4dbe-89ae-8919499c6640" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b19abec-0da9-40cf-91b5-8651b42e513d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:20 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640
Apr 13 11:27:20 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:20 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Flow 'volume_create_manager' (01267bbe-6892-4f2c-bd66-f2ada3edda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81392085-f99b-4db0-b176-180e594c4c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 1073741824" returned: 0 in 0.604s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81392085-f99b-4db0-b176-180e594c4c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1054334692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8109762-ff74-4f4d-bdc8-a47bd084a6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c198fc8a67408c97445a57ad11aa3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:21Z,use_quota=True,user_id='cfdd65e4aad249939ce782db71a80d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09362c9-b194-4c9c-9723-709d7fb5abf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09362c9-b194-4c9c-9723-709d7fb5abf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb5fa5a-f2bb-4cbe-88a7-0b4238ec0d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb5fa5a-f2bb-4cbe-88a7-0b4238ec0d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8109762-ff74-4f4d-bdc8-a47bd084a6d8', 'volume_name': 'volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012fefe2-85c2-4d3b-aa71-bbfec44483da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012fefe2-85c2-4d3b-aa71-bbfec44483da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e51ef38-9d43-431b-9315-f0fecdcac7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:20 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Volume b8109762-ff74-4f4d-bdc8-a47bd084a6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8', 'volume_size': 1}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:20 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640" returned: 0 in 0.572s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:20 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:20 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169
Apr 13 11:27:20 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:20 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640
Apr 13 11:27:20 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (feba2ec4-6734-4e12-9284-e55e3942d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bae0e7-3a74-4153-a066-ecf1884ac174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bae0e7-3a74-4153-a066-ecf1884ac174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-470636285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e276a-d0f3-4e83-82ab-a7550499d797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146b15f2da9b439582d00d94fba45ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ecf99f04-c4cc-4552-ad98-89c1f8544a8b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:21Z,use_quota=True,user_id='73418b7e5e3843dea308f4089dcaed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfdcf41-cda7-4c95-be88-23f765d8375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfdcf41-cda7-4c95-be88-23f765d8375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446d5b12-d680-4744-bce5-09ceb9b2cbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446d5b12-d680-4744-bce5-09ceb9b2cbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '208e276a-d0f3-4e83-82ab-a7550499d797', 'volume_name': 'volume-208e276a-d0f3-4e83-82ab-a7550499d797', 'volume_size': 1, 'snapshot_id': 'ecf99f04-c4cc-4552-ad98-89c1f8544a8b'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5f44da-208b-4ad8-84c2-a7659b9a2389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5f44da-208b-4ad8-84c2-a7659b9a2389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d2da02-f912-44e0-a131-4abd6f26429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:21 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Volume 208e276a-d0f3-4e83-82ab-a7550499d797: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-208e276a-d0f3-4e83-82ab-a7550499d797', 'volume_size': 1, 'snapshot_id': 'ecf99f04-c4cc-4552-ad98-89c1f8544a8b'}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:21 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-516bcb29-784b-4dbe-89ae-8919499c6640" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-516bcb29-784b-4dbe-89ae-8919499c6640" released by "delete_volume" :: held 1.069s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:21 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169" returned: 0 in 0.532s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.924s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165656286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:17Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating volume 0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:21 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b27766-37d4-429d-8a1e-3faad1777626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22642adb-e2c6-414a-b34c-3c51a51b8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:21 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb 1073741824
Apr 13 11:27:21 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:21 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 (3d4c49d5-31c8-4305-9b0e-f3e2afd33169): created successfully
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22642adb-e2c6-414a-b34c-3c51a51b8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (56747bc3-82e7-4750-b8a7-00cb687b7770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:21 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c8e73e48-df15-4fb2-8e91-fdeb547e3be5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created volume successfully.
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Created reservations ['40880207-9859-4834-9df9-0013fb3bbfb5', 'bbf869f4-dc03-43ea-a54a-00cd9f5d8d4c', 'b3e5e640-88f7-472f-a75a-2b21034472c0', 'f50a9364-ee0b-4fae-883e-5a3bda2e378a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:21 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:21 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:21 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.424s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:21 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb 1073741824" returned: 0 in 0.525s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:21 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Deleted volume successfully.
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:21 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8a3fecfa-7636-458f-9665-87c643b7325b tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-516bcb29-784b-4dbe-89ae-8919499c6640-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:21 devstack sudo[89960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb
Apr 13 11:27:21 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:22 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb" returned: 0 in 0.465s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.614s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877495127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8142e5-47f6-492d-9fb5-0687e63d527e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:17Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating volume db8142e5-47f6-492d-9fb5-0687e63d527e {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:22 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4694403-f0f7-4a47-8ada-7c1dfbe62449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb191d96-ae75-4b0b-ac69-06c819298219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:22 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e 1073741824
Apr 13 11:27:22 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-b24ba605-9c48-49b0-abcb-e4cf8016aca2-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:22 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb (0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb): created successfully
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb191d96-ae75-4b0b-ac69-06c819298219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (dce2f5b1-b7c6-4570-a879-e51687c5eedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-b24ba605-9c48-49b0-abcb-e4cf8016aca2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:22 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-e069dbd6-7e73-4e68-bdb9-a60d0b397be3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created volume successfully.
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "cinder-quobyte-b24ba605-9c48-49b0-abcb-e4cf8016aca2" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-b24ba605-9c48-49b0-abcb-e4cf8016aca2" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc5f059-2c81-4df7-9538-b71d2c463a69]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:22 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2
Apr 13 11:27:22 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:22 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e 1073741824" returned: 0 in 0.591s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:22 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2" returned: 0 in 0.513s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:22 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:22 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e
Apr 13 11:27:22 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:22 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2
Apr 13 11:27:22 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:23 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e" returned: 0 in 0.421s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.260s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40349479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385eeeb5-6e92-43bf-bd93-ac2506ddf378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:18Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating volume 385eeeb5-6e92-43bf-bd93-ac2506ddf378 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:23 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8266766f-2227-4192-916f-ef2232d25f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8142e5-47f6-492d-9fb5-0687e63d527e', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:23 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 1073741824
Apr 13 11:27:23 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09be4ff-f924-463a-b09a-1b54ea6e0bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:23 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b24ba605-9c48-49b0-abcb-e4cf8016aca2" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:23 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume volume-db8142e5-47f6-492d-9fb5-0687e63d527e (db8142e5-47f6-492d-9fb5-0687e63d527e): created successfully
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09be4ff-f924-463a-b09a-1b54ea6e0bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (1299238b-ce32-42d6-92b7-af566d4250ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-quobyte-b24ba605-9c48-49b0-abcb-e4cf8016aca2" released by "delete_volume" :: held 1.012s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2ed073fc-2c1a-4419-a71c-55d0125e4efb tempest-CreateVolumesFromSnapshotTest-134427081 None] Created volume successfully.
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Created reservations ['ac2ff015-c91c-4663-8f8d-895ade7780a7', 'a78eadf3-7efd-44fc-b624-0cdfd231d5de', 'fb654203-e6fc-401d-b226-02d6cd8d0ed9', '56b2d101-be4d-431b-8226-adb8797b8f7a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:23 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:23 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:23 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 1073741824" returned: 0 in 0.514s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:23 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378
Apr 13 11:27:23 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:23 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.421s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:23 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Deleted volume successfully.
Apr 13 11:27:23 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-7bf4f994-ee12-40d6-a8ad-9edc656a4cec tempest-CreateVolumesFromImageTest-357886890 None] Lock "cinder-b24ba605-9c48-49b0-abcb-e4cf8016aca2-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:24 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378" returned: 0 in 0.420s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.116s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-492421677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf79072d-7228-4772-b927-29a07c8b7f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcdb7122bd2464c864851c3de88040b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:18Z,use_quota=True,user_id='1b3f27b3f34e4481bd3da289058c179c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Creating volume cf79072d-7228-4772-b927-29a07c8b7f60 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:24 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5390bf5-5a1a-4b37-a7e4-86289e99755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:24 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60 1073741824
Apr 13 11:27:24 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dffa148-102e-4ea9-b476-8c09e6f4c83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:24 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 (385eeeb5-6e92-43bf-bd93-ac2506ddf378): created successfully
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dffa148-102e-4ea9-b476-8c09e6f4c83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (dd2306d1-f852-4d27-9180-04d0c6e9179f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:24 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-7fe7708d-888e-4cc9-9b2d-2cf9d47a3939 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created volume successfully.
Apr 13 11:27:24 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60 1073741824" returned: 0 in 0.561s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:24 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:24 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60
Apr 13 11:27:24 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:25 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60" returned: 0 in 0.578s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.788s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1054334692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8109762-ff74-4f4d-bdc8-a47bd084a6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c198fc8a67408c97445a57ad11aa3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:21Z,use_quota=True,user_id='cfdd65e4aad249939ce782db71a80d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Creating volume b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:25 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=106,cinder:INSERT=28,cinder:UPDATE=135,cinder:DELETE=12 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a96be6-7d5c-4212-8757-fb82ca8e4aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf79072d-7228-4772-b927-29a07c8b7f60', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:25 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 1073741824
Apr 13 11:27:25 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d5b0cb-4605-4a2a-848a-edff97103a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:SELECT=91,cinder:UPDATE=126,cinder:DELETE=15,cinder:INSERT=32 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:27:25 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Volume volume-cf79072d-7228-4772-b927-29a07c8b7f60 (cf79072d-7228-4772-b927-29a07c8b7f60): created successfully
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d5b0cb-4605-4a2a-848a-edff97103a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Flow 'volume_create_manager' (69d3daa9-def1-47cd-b5c0-0e6453556b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:25 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b692db95-e9f5-4314-8416-902056c5ec2c tempest-CreateVolumesFromSnapshotTest-134427081 None] Created volume successfully.
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-cf79072d-7228-4772-b927-29a07c8b7f60-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-cf79072d-7228-4772-b927-29a07c8b7f60-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-cf79072d-7228-4772-b927-29a07c8b7f60" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-cf79072d-7228-4772-b927-29a07c8b7f60" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e8bd02-9286-4e56-8d4e-49ade9832b58]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:25 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:25 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60
Apr 13 11:27:25 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:26 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 1073741824" returned: 0 in 0.604s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:26 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:26 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (047396d9-18e2-457f-a7b5-cd918e2333dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b961ec42-98f0-4ce2-a566-60ac8edb335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b961ec42-98f0-4ce2-a566-60ac8edb335a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312116806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55afedbb-38f6-486d-af9a-0e2b1a312f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:26Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b69e18-83c5-41b3-8dbc-a050b5ebe4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:26 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b69e18-83c5-41b3-8dbc-a050b5ebe4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6f2af2-996c-418e-83c0-001c7d933545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6f2af2-996c-418e-83c0-001c7d933545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55afedbb-38f6-486d-af9a-0e2b1a312f98', 'volume_name': 'volume-55afedbb-38f6-486d-af9a-0e2b1a312f98', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3809149e-51fe-4587-92d7-4fc70655e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3809149e-51fe-4587-92d7-4fc70655e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ce0971-f800-4a08-94de-0a9c2fc4f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:26 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume 55afedbb-38f6-486d-af9a-0e2b1a312f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55afedbb-38f6-486d-af9a-0e2b1a312f98', 'volume_size': 1}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60" returned: 0 in 0.686s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:26 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60
Apr 13 11:27:26 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:26 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.442s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.392s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-ecf99f04-c4cc-4552-ad98-89c1f8544a8b-208e276a-d0f3-4e83-82ab-a7550499d797" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e51ef38-9d43-431b-9315-f0fecdcac7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e563a29f-7c79-4037-be87-0d7b9d5f8b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-ecf99f04-c4cc-4552-ad98-89c1f8544a8b-208e276a-d0f3-4e83-82ab-a7550499d797" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Creating volume 208e276a-d0f3-4e83-82ab-a7550499d797 from snapshot ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-208e276a-d0f3-4e83-82ab-a7550499d797" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:26 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Volume volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 (b8109762-ff74-4f4d-bdc8-a47bd084a6d8): created successfully
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e563a29f-7c79-4037-be87-0d7b9d5f8b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Flow 'volume_create_manager' (01267bbe-6892-4f2c-bd66-f2ada3edda9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-208e276a-d0f3-4e83-82ab-a7550499d797" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] snapshot: ecf99f04-c4cc-4552-ad98-89c1f8544a8b, volume: 208e276a-d0f3-4e83-82ab-a7550499d797,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:27:26 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-b9a68697-adca-4b4c-9695-a67e53116754 tempest-SnapshotDependencyTests-1599762827 None] Created volume successfully.
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127bf83-f284-4358-9b90-48ee47b64e41]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:26 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b
Apr 13 11:27:26 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:26 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-cf79072d-7228-4772-b927-29a07c8b7f60" returned: 0 in 0.446s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-cf79072d-7228-4772-b927-29a07c8b7f60" released by "delete_volume" :: held 1.156s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['86922664-ae19-40fa-8462-a2aef679b7ea', '750ae574-6edc-4a52-bf1c-a19c05b916df', '3d384172-2d7d-4bd5-9a32-e1a84d5f9f9a', '5c7072e2-211d-4a1b-b250-a1352c94ba5c'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:26 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:26 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:26 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:27 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b" returned: 0 in 0.561s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce54602-a1c1-490d-a54b-6b71be381c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc4990-525f-42d9-823c-f7bf429ef07b]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:27 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:27 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:27 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:27 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleted volume successfully.
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-601a1e1f-69c0-4ea8-a7da-092e5322f1f3 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-cf79072d-7228-4772-b927-29a07c8b7f60-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:27 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.514s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:27 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797
Apr 13 11:27:27 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-385eeeb5-6e92-43bf-bd93-ac2506ddf378-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-385eeeb5-6e92-43bf-bd93-ac2506ddf378-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-385eeeb5-6e92-43bf-bd93-ac2506ddf378" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-385eeeb5-6e92-43bf-bd93-ac2506ddf378" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed536d-bd24-4246-9add-a0e23a8268bc]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:27 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:27 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378
Apr 13 11:27:27 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:28 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378" returned: 0 in 0.942s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:28 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:28 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378
Apr 13 11:27:28 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:29 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797" returned: 0 in 2.095s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feedafa-d6dd-4833-9aae-fa16f43409d5]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:29 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-385eeeb5-6e92-43bf-bd93-ac2506ddf378" returned: 0 in 1.015s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:29 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:29 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-385eeeb5-6e92-43bf-bd93-ac2506ddf378" released by "delete_volume" :: held 1.983s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['e29d4dc2-2d72-4107-8275-aedb57897ed9', '8fcd1457-782e-49d3-8f60-ee68cef27b94', 'eef62aae-cd0e-4b08-b860-30a067c6c8ed', 'db588de6-ccd8-4dba-82db-ce0ed2a86b9a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:29 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:29 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:29 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-db8142e5-47f6-492d-9fb5-0687e63d527e-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-db8142e5-47f6-492d-9fb5-0687e63d527e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-db8142e5-47f6-492d-9fb5-0687e63d527e" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-db8142e5-47f6-492d-9fb5-0687e63d527e" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2724c81a-1be5-4b18-9985-bc9f19001c3c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:30 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e
Apr 13 11:27:30 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:30 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.625s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:27:30 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Converted 1024.00 MB image at 488.30 MB/s
Apr 13 11:27:30 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 is being set with open permissions: ugo+rw
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:30 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797
Apr 13 11:27:30 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:30 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.491s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleted volume successfully.
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-761ad79e-a929-4948-a98f-a2d2662ff87e tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-385eeeb5-6e92-43bf-bd93-ac2506ddf378-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:30 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e" returned: 0 in 0.492s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:30 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e
Apr 13 11:27:30 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:30 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797" returned: 0 in 0.465s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-208e276a-d0f3-4e83-82ab-a7550499d797" released by "_copy_volume_from_snapshot" :: held 4.322s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-ecf99f04-c4cc-4552-ad98-89c1f8544a8b-208e276a-d0f3-4e83-82ab-a7550499d797" released by "_create_volume_from_snapshot" :: held 4.351s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.375s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.502s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312116806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55afedbb-38f6-486d-af9a-0e2b1a312f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:26Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Creating volume 55afedbb-38f6-486d-af9a-0e2b1a312f98 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:30 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:30 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 1073741824
Apr 13 11:27:30 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d2da02-f912-44e0-a131-4abd6f26429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208e276a-d0f3-4e83-82ab-a7550499d797', 'volume_size': 1, 'snapshot_id': 'ecf99f04-c4cc-4552-ad98-89c1f8544a8b'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6c2173-5808-41c1-9020-2707280519f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:30 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Volume volume-208e276a-d0f3-4e83-82ab-a7550499d797 (208e276a-d0f3-4e83-82ab-a7550499d797): created successfully
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6c2173-5808-41c1-9020-2707280519f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:30 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (feba2ec4-6734-4e12-9284-e55e3942d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:30 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-0c202dac-c313-4d48-9864-6e72cef0726f tempest-VolumeDependencyTests-1445316855 None] Created volume successfully.
Apr 13 11:27:31 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-db8142e5-47f6-492d-9fb5-0687e63d527e" returned: 0 in 0.458s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-db8142e5-47f6-492d-9fb5-0687e63d527e" released by "delete_volume" :: held 0.970s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['30413fa1-57ac-42b9-aac0-5aeed586689a', '7c0d667d-76a3-4494-b2aa-15f8f2db2f7e', 'b88092ff-5270-45b0-91df-449e1e09a5b4', 'b80949ee-4ed1-4d18-a07d-e665d1d61613'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:31 devstack sudo[90071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:31 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:31 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 1073741824" returned: 0 in 0.501s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:31 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98
Apr 13 11:27:31 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:31 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.424s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:31 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleted volume successfully.
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-2b25802d-6cfa-4c64-88fb-39108a9a4745 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-db8142e5-47f6-492d-9fb5-0687e63d527e-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-ecf99f04-c4cc-4552-ad98-89c1f8544a8b-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-ecf99f04-c4cc-4552-ad98-89c1f8544a8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-bce54602-a1c1-490d-a54b-6b71be381c35" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-bce54602-a1c1-490d-a54b-6b71be381c35" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-ecf99f04-c4cc-4552-ad98-89c1f8544a8b" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-ecf99f04-c4cc-4552-ad98-89c1f8544a8b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Deleting offline snapshot ecf99f04-c4cc-4552-ad98-89c1f8544a8b of volume bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] snapshot_file for this snap is: volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d8fb2-d39f-4627-81a2-70b1f22f28be]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:31 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98" returned: 0 in 0.433s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.742s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ce0971-f800-4a08-94de-0a9c2fc4f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55afedbb-38f6-486d-af9a-0e2b1a312f98', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592d97c2-ada3-4f72-8273-e982de103215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Creating offline snapshot 485d3641-7d4f-4d1e-a7e4-385ec8030b5b of volume b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:27:31 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 (55afedbb-38f6-486d-af9a-0e2b1a312f98): created successfully
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592d97c2-ada3-4f72-8273-e982de103215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (047396d9-18e2-457f-a7b5-cd918e2333dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d744c898-2a26-4934-8b14-89c1bcb4164c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:31 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:31 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-93f82e25-f807-49ff-b4ec-6aa0a3b3b1db tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created volume successfully.
Apr 13 11:27:31 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b
Apr 13 11:27:31 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:31 devstack sudo[90081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:31 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100c6bc-5c8e-4058-8ea6-8fd5f622b6b0]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:32 devstack sudo[90087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb
Apr 13 11:27:32 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:32 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b" returned: 0 in 0.529s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce54602-a1c1-490d-a54b-6b71be381c35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0647c4b-923a-4516-8eee-720998d812a7]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:32 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:32 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b 1G
Apr 13 11:27:32 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:32 devstack sudo[90092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:32 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:32 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb" returned: 0 in 0.504s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:32 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb
Apr 13 11:27:32 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:32 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.540s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:32 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b
Apr 13 11:27:32 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:32 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b 1G" returned: 0 in 0.554s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:32 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:32 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b
Apr 13 11:27:32 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (483f8271-e1d7-4600-836a-b9b60a6ed437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9ca85-18cf-4e45-be11-e3159605a389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9ca85-18cf-4e45-be11-e3159605a389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-802108997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba98ce12-a5cd-4e1c-8e39-f9070a624459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:33Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c702fa-61be-43af-9f3f-ca010d0ffaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c702fa-61be-43af-9f3f-ca010d0ffaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b894b34-c9f4-4d59-85fe-50d27b3b9d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b894b34-c9f4-4d59-85fe-50d27b3b9d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba98ce12-a5cd-4e1c-8e39-f9070a624459', 'volume_name': 'volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2827bf-c383-4575-a08a-28ac4d497bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2827bf-c383-4575-a08a-28ac4d497bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fdb838-935b-46bf-88dc-eadebf5e2f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume ba98ce12-a5cd-4e1c-8e39-f9070a624459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459', 'volume_size': 1}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb" returned: 0 in 0.488s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb" released by "delete_volume" :: held 1.025s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['7585f9ac-5c9f-48df-8993-c7f22e12e610', 'd8415aae-6713-4e80-9afa-76e478cef5b6', '944478e6-9495-4c9c-ab9a-1cbd7a5b26bb', '754b4fc6-8961-47f1-b5be-762d51ffdeab'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:33 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:33 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:33 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (771f83a4-82a3-4377-84a6-a39cc48470bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b92b0d8-ae99-423d-8a97-b081112c32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-3d4c49d5-31c8-4305-9b0e-f3e2afd33169-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b" returned: 0 in 0.536s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:33 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b is being set with open permissions: ugo+rw
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:33 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b
Apr 13 11:27:33 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b92b0d8-ae99-423d-8a97-b081112c32b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305609148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfc2305-1ea5-4927-a379-27a64ba122bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:33Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f433d6-9eb6-4b3f-9190-2ae1b6aa86c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f433d6-9eb6-4b3f-9190-2ae1b6aa86c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3ffdd1-d042-410b-aa00-171f0edd4110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3ffdd1-d042-410b-aa00-171f0edd4110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfc2305-1ea5-4927-a379-27a64ba122bb', 'volume_name': 'volume-1bfc2305-1ea5-4927-a379-27a64ba122bb', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bd4e8-62d3-439b-9b55-fb5762779b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6bd4e8-62d3-439b-9b55-fb5762779b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89acfa7c-cb82-49ee-86c6-362d570628e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume 1bfc2305-1ea5-4927-a379-27a64ba122bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfc2305-1ea5-4927-a379-27a64ba122bb', 'volume_size': 1}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-3d4c49d5-31c8-4305-9b0e-f3e2afd33169-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-3d4c49d5-31c8-4305-9b0e-f3e2afd33169" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-3d4c49d5-31c8-4305-9b0e-f3e2afd33169" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc544382-4bc2-40ba-a76a-cfa90aa094bb]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (9ee18489-f21a-44eb-aed9-6390ea4cdd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86eb128e-8ef2-4c56-8f9a-4b855729b8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86eb128e-8ef2-4c56-8f9a-4b855729b8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021267682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177d1b1f-5559-4523-976f-27fb20f74540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:34Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7078c7-75ba-44ef-bb34-ae90fe7d7817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7078c7-75ba-44ef-bb34-ae90fe7d7817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864a5b84-0569-4c28-924b-5a8a0ef37b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864a5b84-0569-4c28-924b-5a8a0ef37b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177d1b1f-5559-4523-976f-27fb20f74540', 'volume_name': 'volume-177d1b1f-5559-4523-976f-27fb20f74540', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdb2e54-4186-451d-86ff-d26b9af607f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdb2e54-4186-451d-86ff-d26b9af607f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d48e849-235e-4c82-9a15-c872048154b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume 177d1b1f-5559-4523-976f-27fb20f74540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177d1b1f-5559-4523-976f-27fb20f74540', 'volume_size': 1}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b" returned: 0 in 0.834s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:33 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169
Apr 13 11:27:33 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:33 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b
Apr 13 11:27:33 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (92be5fdb-b539-4cc7-a9a5-94181eeac3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d12d834-7a94-43e1-89d1-af59edf6b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d12d834-7a94-43e1-89d1-af59edf6b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581831345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eebd11b-aff3-47c6-b1cf-39753cf301e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:34Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8131c552-1ba2-49cd-b0d7-a407e091fc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8131c552-1ba2-49cd-b0d7-a407e091fc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf2617-8f9c-4ca6-b108-57c2ad517243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf2617-8f9c-4ca6-b108-57c2ad517243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eebd11b-aff3-47c6-b1cf-39753cf301e1', 'volume_name': 'volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:33 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05413f9-e07c-484c-8ab0-bbd9a0e1b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05413f9-e07c-484c-8ab0-bbd9a0e1b27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f286d311-6db8-4158-9306-b8de2248b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume 9eebd11b-aff3-47c6-b1cf-39753cf301e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1', 'volume_size': 1}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (5a890ec6-80ea-458e-a057-0b4067a2ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079148cc-bc4d-4332-a470-1520a446aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079148cc-bc4d-4332-a470-1520a446aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-620130723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cd87b0-4582-4298-b6a4-4aea99deded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:34Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daaaf2f-8bb9-4ac8-b09f-251735cd7991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daaaf2f-8bb9-4ac8-b09f-251735cd7991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:34 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15120952-b20c-4bb8-9ac8-a1f57d70721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15120952-b20c-4bb8-9ac8-a1f57d70721b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6cd87b0-4582-4298-b6a4-4aea99deded0', 'volume_name': 'volume-a6cd87b0-4582-4298-b6a4-4aea99deded0', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb58093f-9562-4665-aae7-a76abf155607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb58093f-9562-4665-aae7-a76abf155607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac0313c-5002-46dd-bee5-6e8371094e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:34 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume a6cd87b0-4582-4298-b6a4-4aea99deded0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6cd87b0-4582-4298-b6a4-4aea99deded0', 'volume_size': 1}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b" returned: 0 in 0.727s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.876s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleted volume successfully.
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fb5baa41-67c0-4aed-9693-b9082e455fef tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-0cf9abfa-c5ae-4faf-bd95-60fc8e5d96bb-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:34 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35.ecf99f04-c4cc-4552-ad98-89c1f8544a8b" returned: 0 in 0.508s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:34 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info
Apr 13 11:27:34 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-ecf99f04-c4cc-4552-ad98-89c1f8544a8b" released by "_delete_snapshot" :: held 2.465s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-bce54602-a1c1-490d-a54b-6b71be381c35" released by "delete_snapshot" :: held 2.479s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Created reservations ['6fcdb6bc-c1be-4d00-a3c7-825f5dea0266', '710f094e-34c4-4669-a417-e96cea09e8cc', '5f309724-9e4f-4997-beb7-8b3dff83dde6', '1e3a8f2d-357d-403d-bbde-8f4f7bcacdd3'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:34 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Delete snapshot completed successfully.
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c6610437-078f-4251-80e4-a2d1da6f3d46 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-ecf99f04-c4cc-4552-ad98-89c1f8544a8b-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:34 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169" returned: 0 in 0.777s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:34 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169
Apr 13 11:27:34 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:34 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:34 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info is being set with open permissions: ugo+rw
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:34 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info
Apr 13 11:27:34 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:34 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-3d4c49d5-31c8-4305-9b0e-f3e2afd33169" returned: 0 in 0.420s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-3d4c49d5-31c8-4305-9b0e-f3e2afd33169" released by "delete_volume" :: held 1.219s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['1f6d3a74-cee1-436b-b641-2bd8c5e54943', '5022929f-48ea-4cde-88a8-9f790b24f68b', '702795e3-2e74-4c7f-b9bb-5fe302ec6063', '8cf1f619-a77e-48a4-9e1e-b67f4ee1f103'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:34 devstack sudo[90140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:34 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-bce54602-a1c1-490d-a54b-6b71be381c35-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:34 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-bce54602-a1c1-490d-a54b-6b71be381c35-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-bce54602-a1c1-490d-a54b-6b71be381c35" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-bce54602-a1c1-490d-a54b-6b71be381c35" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e7c5b5-0baa-461f-bc1b-e9880da5ba1f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:35 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:35 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:35 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.info" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.334s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-802108997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba98ce12-a5cd-4e1c-8e39-f9070a624459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:33Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Creating volume ba98ce12-a5cd-4e1c-8e39-f9070a624459 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:35 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:35 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 1073741824
Apr 13 11:27:35 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-167efe47-aff4-456c-bed2-6bb0113a2ba5 tempest-SnapshotDependencyTests-1599762827 None] Create snapshot completed successfully
Apr 13 11:27:35 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:35 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleted volume successfully.
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f67158e-6bd2-4fb9-9887-de0145095450 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-3d4c49d5-31c8-4305-9b0e-f3e2afd33169-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:35 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.591s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-481429f9-1728-4267-90f7-eb533813b561-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-481429f9-1728-4267-90f7-eb533813b561-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-27989c68-91d6-478d-b8fe-f5e477810d44" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:35 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35
Apr 13 11:27:35 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-27989c68-91d6-478d-b8fe-f5e477810d44" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-481429f9-1728-4267-90f7-eb533813b561" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-481429f9-1728-4267-90f7-eb533813b561" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleting offline snapshot 481429f9-1728-4267-90f7-eb533813b561 of volume 27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] snapshot_file for this snap is: volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff136e-aa80-46f4-9211-f3eb8b86d6bf]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:35 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 1073741824" returned: 0 in 0.566s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:35 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561
Apr 13 11:27:35 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:35 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459
Apr 13 11:27:35 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Flow 'volume_create_manager' (2bfef4c4-1089-464e-a2e9-a83280583c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:35 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911a3e44-a3aa-4543-a22d-7da8e6fbf750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911a3e44-a3aa-4543-a22d-7da8e6fbf750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d633f5ef-b78d-49ed-ba9a-85e6659773e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04c198fc8a67408c97445a57ad11aa3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=485d3641-7d4f-4d1e-a7e4-385ec8030b5b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:36Z,use_quota=True,user_id='cfdd65e4aad249939ce782db71a80d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a5d61a-c04a-49e7-8fae-8afc54992cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a5d61a-c04a-49e7-8fae-8afc54992cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bed1539-42bc-4a2d-a7c0-859946aa2803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bed1539-42bc-4a2d-a7c0-859946aa2803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd633f5ef-b78d-49ed-ba9a-85e6659773e5', 'volume_name': 'volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5', 'volume_size': 1, 'snapshot_id': '485d3641-7d4f-4d1e-a7e4-385ec8030b5b'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df4f2b5-50f7-48af-ab47-9147324247cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df4f2b5-50f7-48af-ab47-9147324247cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e24f6-e680-4a9f-b781-287f34dbc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Volume d633f5ef-b78d-49ed-ba9a-85e6659773e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5', 'volume_size': 1, 'snapshot_id': '485d3641-7d4f-4d1e-a7e4-385ec8030b5b'}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:36 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-bce54602-a1c1-490d-a54b-6b71be381c35" returned: 0 in 0.618s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-bce54602-a1c1-490d-a54b-6b71be381c35" released by "delete_volume" :: held 1.237s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Created reservations ['f03d6e36-e499-411d-81c7-d9cc17836864', '719d8591-ff1b-41ed-86b9-6f3e13c814b3', '23484205-b18c-4fcd-9948-13fdfccfe5e5', '903d4f78-fe12-439c-ac36-793b4ff57fed'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:36 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561" returned: 0 in 0.615s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27989c68-91d6-478d-b8fe-f5e477810d44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:36 devstack sudo[90165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:36 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[d979375e-af5e-4158-ab2d-25ffa0938d33]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:36 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459" returned: 0 in 0.567s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305609148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfc2305-1ea5-4927-a379-27a64ba122bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:33Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Creating volume 1bfc2305-1ea5-4927-a379-27a64ba122bb {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:36 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fdb838-935b-46bf-88dc-eadebf5e2f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:36 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb 1073741824
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fc3f90-40b9-42ba-ad70-9128ade8e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:36 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:36 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 (ba98ce12-a5cd-4e1c-8e39-f9070a624459): created successfully
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fc3f90-40b9-42ba-ad70-9128ade8e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (483f8271-e1d7-4600-836a-b9b60a6ed437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:36 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44
Apr 13 11:27:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-6971f84c-d709-444e-a51f-120b47408805 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created volume successfully.
Apr 13 11:27:36 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:36 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.461s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:36 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Deleted volume successfully.
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bb4fcfe1-1165-45d7-bfd1-a2c7b77ce1b7 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-bce54602-a1c1-490d-a54b-6b71be381c35-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:36 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44" returned: 0 in 0.529s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:36 devstack sudo[90178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561
Apr 13 11:27:36 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:36 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb 1073741824" returned: 0 in 0.560s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:36 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:36 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb
Apr 13 11:27:36 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:37 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561" returned: 0 in 0.544s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:37 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561
Apr 13 11:27:37 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (4ea870ce-5c07-4c0a-953c-245d8979d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad419737-56cb-47dc-9283-d93d83811b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:37 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad419737-56cb-47dc-9283-d93d83811b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1850194625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e1f05c-9f86-4020-adfb-a72166e2fbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146b15f2da9b439582d00d94fba45ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:37Z,use_quota=True,user_id='73418b7e5e3843dea308f4089dcaed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9400d36-a7dc-487d-80df-2a6937dffaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9400d36-a7dc-487d-80df-2a6937dffaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6cb8c9-780a-4662-b054-307e7f1d02a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6cb8c9-780a-4662-b054-307e7f1d02a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'volume_name': 'volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1129ae61-5d53-4246-995e-484431f74918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1129ae61-5d53-4246-995e-484431f74918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a8080d-f504-43f6-b6aa-af4920d1c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:37 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Volume a8e1f05c-9f86-4020-adfb-a72166e2fbfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'volume_size': 1}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb" returned: 0 in 0.541s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.768s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1021267682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177d1b1f-5559-4523-976f-27fb20f74540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:34Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Creating volume 177d1b1f-5559-4523-976f-27fb20f74540 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:37 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89acfa7c-cb82-49ee-86c6-362d570628e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfc2305-1ea5-4927-a379-27a64ba122bb', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:37 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540 1073741824
Apr 13 11:27:37 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c83542c-71aa-4d3f-97e1-461f47c39e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:37 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume volume-1bfc2305-1ea5-4927-a379-27a64ba122bb (1bfc2305-1ea5-4927-a379-27a64ba122bb): created successfully
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c83542c-71aa-4d3f-97e1-461f47c39e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (771f83a4-82a3-4377-84a6-a39cc48470bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-668b71d3-aee4-4d8a-8e77-f8c61f8eae9f tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created volume successfully.
Apr 13 11:27:37 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44.481429f9-1728-4267-90f7-eb533813b561" returned: 0 in 0.435s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-481429f9-1728-4267-90f7-eb533813b561" released by "_delete_snapshot" :: held 2.192s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-27989c68-91d6-478d-b8fe-f5e477810d44" released by "delete_snapshot" :: held 2.212s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['92c36000-13ce-445c-9b38-115ed35ec3bf', '789ea308-b887-44e6-b1bc-22d30a5c5dfe', 'c25c6ae0-5038-4b3f-889d-5d53b98bacda', 'b13b9e30-bb94-4c62-87c5-a7f0c86ff1b7'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:37 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Delete snapshot completed successfully.
Apr 13 11:27:37 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5eb649eb-ee51-4e12-a19c-b8330942cfc5 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-481429f9-1728-4267-90f7-eb533813b561-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:38 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540 1073741824" returned: 0 in 0.565s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:38 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540
Apr 13 11:27:38 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:38 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540" returned: 0 in 0.444s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.553s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-581831345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eebd11b-aff3-47c6-b1cf-39753cf301e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:34Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Creating volume 9eebd11b-aff3-47c6-b1cf-39753cf301e1 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:38 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d48e849-235e-4c82-9a15-c872048154b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177d1b1f-5559-4523-976f-27fb20f74540', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:38 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 1073741824
Apr 13 11:27:38 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8034a7-e5f1-49b2-a012-c7d54fc6db08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:38 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume volume-177d1b1f-5559-4523-976f-27fb20f74540 (177d1b1f-5559-4523-976f-27fb20f74540): created successfully
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8034a7-e5f1-49b2-a012-c7d54fc6db08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (9ee18489-f21a-44eb-aed9-6390ea4cdd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:38 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8ba89b47-74d3-4c80-879c-942f1779c74a tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created volume successfully.
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-27989c68-91d6-478d-b8fe-f5e477810d44-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-27989c68-91d6-478d-b8fe-f5e477810d44-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "cinder-quobyte-27989c68-91d6-478d-b8fe-f5e477810d44" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-27989c68-91d6-478d-b8fe-f5e477810d44" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a5c511-212e-480b-af93-6c55535755a2]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:38 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:38 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44
Apr 13 11:27:38 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:39 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 1073741824" returned: 0 in 0.561s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:39 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1
Apr 13 11:27:39 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:39 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44" returned: 0 in 0.534s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:39 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44
Apr 13 11:27:39 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:39 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1" returned: 0 in 0.460s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-620130723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cd87b0-4582-4298-b6a4-4aea99deded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75ed9cb836e4802a745b43f12279332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:34Z,use_quota=True,user_id='cde920cfd7644265bbd6c6d10e6f73f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Creating volume a6cd87b0-4582-4298-b6a4-4aea99deded0 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:39 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f286d311-6db8-4158-9306-b8de2248b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:39 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 1073741824
Apr 13 11:27:39 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb458e43-5ef2-487f-a3a9-37d345a462c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:39 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 (9eebd11b-aff3-47c6-b1cf-39753cf301e1): created successfully
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb458e43-5ef2-487f-a3a9-37d345a462c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (92be5fdb-b539-4cc7-a9a5-94181eeac3be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:39 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-d0e6e165-776f-4154-858c-8a4f4ad471b0 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created volume successfully.
Apr 13 11:27:39 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-27989c68-91d6-478d-b8fe-f5e477810d44" returned: 0 in 0.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-quobyte-27989c68-91d6-478d-b8fe-f5e477810d44" released by "delete_volume" :: held 1.036s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Created reservations ['40c80a56-1060-4a0e-8dcb-7b9da5902f5c', '2aea0fa9-e63c-4078-9130-d7f58f6d9631', '74eb10d5-6a7e-4be7-b6ae-9631ffc2cdbf', 'f240ed9f-6cef-4e48-8091-f54fb3b1329f'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:39 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:39 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:39 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:40 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 1073741824" returned: 0 in 0.556s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:40 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0
Apr 13 11:27:40 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:40 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.487s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Deleted volume successfully.
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-48403d9c-8d8a-4c79-89dc-cd2c8035a1a6 tempest-CreateVolumesFromSnapshotTest-134427081 None] Lock "cinder-27989c68-91d6-478d-b8fe-f5e477810d44-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:40 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.631s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-quobyte-485d3641-7d4f-4d1e-a7e4-385ec8030b5b-d633f5ef-b78d-49ed-ba9a-85e6659773e5" by "_create_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac0313c-5002-46dd-bee5-6e8371094e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cd87b0-4582-4298-b6a4-4aea99deded0', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645636b2-7bbb-4508-8a34-cd701ef7549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-485d3641-7d4f-4d1e-a7e4-385ec8030b5b-d633f5ef-b78d-49ed-ba9a-85e6659773e5" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Creating volume d633f5ef-b78d-49ed-ba9a-85e6659773e5 from snapshot 485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-quobyte-d633f5ef-b78d-49ed-ba9a-85e6659773e5" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:40 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Volume volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 (a6cd87b0-4582-4298-b6a4-4aea99deded0): created successfully
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (645636b2-7bbb-4508-8a34-cd701ef7549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Flow 'volume_create_manager' (5a890ec6-80ea-458e-a057-0b4067a2ae10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:40 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a0b375cc-a17a-47b6-9c88-a8869a6711ca tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created volume successfully.
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-d633f5ef-b78d-49ed-ba9a-85e6659773e5" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] snapshot: 485d3641-7d4f-4d1e-a7e4-385ec8030b5b, volume: d633f5ef-b78d-49ed-ba9a-85e6659773e5,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[7341547d-fe94-46b0-99f6-437ae1b25e9e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:40 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:40 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b
Apr 13 11:27:40 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:41 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b" returned: 0 in 0.570s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18fe9d3-1640-4f6b-8a9e-0de6c16fe2a4]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:41 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:41 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-a6cd87b0-4582-4298-b6a4-4aea99deded0-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-a6cd87b0-4582-4298-b6a4-4aea99deded0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-quobyte-a6cd87b0-4582-4298-b6a4-4aea99deded0" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-a6cd87b0-4582-4298-b6a4-4aea99deded0" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf6d83-22ac-427c-8d04-c1395c536ac2]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:41 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:41 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0
Apr 13 11:27:41 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:42 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.668s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:42 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:27:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:42 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5
Apr 13 11:27:42 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:42 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0" returned: 0 in 0.606s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:42 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:42 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0
Apr 13 11:27:42 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:43 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:43 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a6cd87b0-4582-4298-b6a4-4aea99deded0" returned: 0 in 1.260s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:43 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-a6cd87b0-4582-4298-b6a4-4aea99deded0" released by "delete_volume" :: held 1.900s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:43 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created reservations ['cb323244-8bdd-4b77-9f75-122a9457d3cc', 'f1dda1e4-bce6-4d09-9b2a-2ffc2d9a0b4b', 'efe826ec-3e8d-49dc-95ae-d4e255121f91', '53c68440-6b82-460e-ae1f-3e2fa46934c9'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:44 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:44 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-9eebd11b-aff3-47c6-b1cf-39753cf301e1-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-9eebd11b-aff3-47c6-b1cf-39753cf301e1-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-quobyte-9eebd11b-aff3-47c6-b1cf-39753cf301e1" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-9eebd11b-aff3-47c6-b1cf-39753cf301e1" acquired by "delete_volume" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[89047caa-2582-441a-8919-9b34dfa1e3b9]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Flow 'volume_create_manager' (d5708c28-e2c6-4123-83ad-dff8631b630e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c210c427-31c7-497b-a557-99915d7c1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c210c427-31c7-497b-a557-99915d7c1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80adebf-3612-4e5c-b65e-565451d6c83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d775b8dbd74aa2a998cbc19e872728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:44Z,use_quota=True,user_id='e9dff2143b2f45deb7d5bff91e4a6510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2797ddb-e03d-4c41-b87b-4e1405768f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2797ddb-e03d-4c41-b87b-4e1405768f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d95eddb-f58a-484b-9a98-63d073825732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d95eddb-f58a-484b-9a98-63d073825732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f80adebf-3612-4e5c-b65e-565451d6c83a', 'volume_name': 'volume-f80adebf-3612-4e5c-b65e-565451d6c83a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d051e2d-118f-4145-a7d5-8ff87421dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d051e2d-118f-4145-a7d5-8ff87421dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a451858e-344e-477f-b2f1-7cd0f6eef6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:44 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Volume f80adebf-3612-4e5c-b65e-565451d6c83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f80adebf-3612-4e5c-b65e-565451d6c83a', 'volume_size': 1}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:44 devstack sudo[90257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1
Apr 13 11:27:44 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:44 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5" returned: 0 in 2.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a1809-62d9-41c6-a248-a92414ce27b6]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:44 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:44 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:44 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.755s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:44 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Deleted volume successfully.
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c0d0aab8-608a-47e3-a35b-4c1559391bd7 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-a6cd87b0-4582-4298-b6a4-4aea99deded0-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:44 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1" returned: 0 in 0.515s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:44 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:44 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1
Apr 13 11:27:44 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:45 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.615s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8, size 1024.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:27:45 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Converted 1024.00 MB image at 409.00 MB/s
Apr 13 11:27:45 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 is being set with open permissions: ugo+rw
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:45 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5
Apr 13 11:27:45 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:45 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-9eebd11b-aff3-47c6-b1cf-39753cf301e1" returned: 0 in 0.433s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-9eebd11b-aff3-47c6-b1cf-39753cf301e1" released by "delete_volume" :: held 0.999s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created reservations ['be3c59ff-769f-40c1-b3bf-ec605a386f64', '2468a582-b45a-4534-9d55-157f57eaabf4', '703bee8b-7a4b-434f-896b-7c60fa86e426', 'b9bdce44-d241-42b4-8500-cfb4724d1417'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:45 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:45 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:45 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5" returned: 0 in 0.451s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-d633f5ef-b78d-49ed-ba9a-85e6659773e5" released by "_copy_volume_from_snapshot" :: held 4.866s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-485d3641-7d4f-4d1e-a7e4-385ec8030b5b-d633f5ef-b78d-49ed-ba9a-85e6659773e5" released by "_create_volume_from_snapshot" :: held 4.903s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.926s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.090s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1850194625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e1f05c-9f86-4020-adfb-a72166e2fbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146b15f2da9b439582d00d94fba45ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:37Z,use_quota=True,user_id='73418b7e5e3843dea308f4089dcaed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Creating volume a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:45 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:45 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb 1073741824
Apr 13 11:27:45 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e24f6-e680-4a9f-b781-287f34dbc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5', 'volume_size': 1, 'snapshot_id': '485d3641-7d4f-4d1e-a7e4-385ec8030b5b'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032df519-d6bd-48c5-bbd9-096f655628d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:45 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Volume volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 (d633f5ef-b78d-49ed-ba9a-85e6659773e5): created successfully
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032df519-d6bd-48c5-bbd9-096f655628d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Flow 'volume_create_manager' (2bfef4c4-1089-464e-a2e9-a83280583c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:45 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-61f85b2a-f890-44d4-a169-54348fa0a429 tempest-SnapshotDependencyTests-1599762827 None] Created volume successfully.
Apr 13 11:27:45 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.423s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:45 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Deleted volume successfully.
Apr 13 11:27:45 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-93c61a49-84da-41a0-a935-e9d0239710e9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-9eebd11b-aff3-47c6-b1cf-39753cf301e1-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:46 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb 1073741824" returned: 0 in 0.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:46 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:46 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-177d1b1f-5559-4523-976f-27fb20f74540-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-177d1b1f-5559-4523-976f-27fb20f74540-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-quobyte-177d1b1f-5559-4523-976f-27fb20f74540" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-177d1b1f-5559-4523-976f-27fb20f74540" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[997754c2-cfb5-4f99-9df9-9f0f4fc83514]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:46 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.409s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80adebf-3612-4e5c-b65e-565451d6c83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d775b8dbd74aa2a998cbc19e872728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:44Z,use_quota=True,user_id='e9dff2143b2f45deb7d5bff91e4a6510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Creating volume f80adebf-3612-4e5c-b65e-565451d6c83a {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:46 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540
Apr 13 11:27:46 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:46 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a8080d-f504-43f6-b6aa-af4920d1c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:46 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a 1073741824
Apr 13 11:27:46 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af4dca6-b081-4341-9106-07fba6f8a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:46 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Volume volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb (a8e1f05c-9f86-4020-adfb-a72166e2fbfb): created successfully
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af4dca6-b081-4341-9106-07fba6f8a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (4ea870ce-5c07-4c0a-953c-245d8979d251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:46 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-a89da73a-cca1-478d-820d-a8c2f3ad5757 tempest-VolumeDependencyTests-1445316855 None] Created volume successfully.
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-485d3641-7d4f-4d1e-a7e4-385ec8030b5b-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-485d3641-7d4f-4d1e-a7e4-385ec8030b5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-quobyte-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-quobyte-485d3641-7d4f-4d1e-a7e4-385ec8030b5b" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-485d3641-7d4f-4d1e-a7e4-385ec8030b5b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Deleting offline snapshot 485d3641-7d4f-4d1e-a7e4-385ec8030b5b of volume b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] snapshot_file for this snap is: volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6fa7b-607e-46bb-bd77-7dead115d915]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:46 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:46 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b
Apr 13 11:27:46 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:47 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540" returned: 0 in 0.585s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:47 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a 1073741824" returned: 0 in 0.520s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:47 devstack sudo[90297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540
Apr 13 11:27:47 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:47 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a
Apr 13 11:27:47 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:47 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b" returned: 0 in 0.685s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92f359b-c0a9-472e-88af-8d2dbdf44e43]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:47 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-177d1b1f-5559-4523-976f-27fb20f74540" returned: 0 in 0.474s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-177d1b1f-5559-4523-976f-27fb20f74540" released by "delete_volume" :: held 1.091s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (3d2755fd-b25c-475d-9647-adb98a2309c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b97c022-292d-498b-8677-05840740ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b97c022-292d-498b-8677-05840740ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1491478204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e643b259-9927-461b-934d-58597040b34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146b15f2da9b439582d00d94fba45ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a8e1f05c-9f86-4020-adfb-a72166e2fbfb,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:47Z,use_quota=True,user_id='73418b7e5e3843dea308f4089dcaed81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef54eb54-361b-48bc-afb2-8db8a451898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef54eb54-361b-48bc-afb2-8db8a451898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:47 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:47 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081197f4-80cf-47fd-9ca6-839b03795d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081197f4-80cf-47fd-9ca6-839b03795d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e643b259-9927-461b-934d-58597040b34f', 'volume_name': 'volume-e643b259-9927-461b-934d-58597040b34f', 'volume_size': 1, 'source_volid': 'a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a55709-7328-49e1-b066-ac85ebca36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a55709-7328-49e1-b066-ac85ebca36bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e4b918-cc24-42f5-9527-deec0c6c8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:47 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Volume e643b259-9927-461b-934d-58597040b34f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e643b259-9927-461b-934d-58597040b34f', 'volume_size': 1, 'source_volid': 'a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'source_volstatus': 'available'}
Apr 13 11:27:47 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a" returned: 0 in 0.537s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:47 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Cloning volume a8e1f05c-9f86-4020-adfb-a72166e2fbfb to volume e643b259-9927-461b-934d-58597040b34f
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a451858e-344e-477f-b2f1-7cd0f6eef6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80adebf-3612-4e5c-b65e-565451d6c83a', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabaef58-afd8-463f-b785-bbbb9ac56cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created reservations ['f45502f5-36ce-47f2-98e1-4f83231bf405', '005fb9b4-c475-4892-b935-3ed9c271c56d', 'e1f9b8d6-cc92-45ca-b492-3242f0f80643', '5005e12a-b4f8-46f9-874e-00b8ba231ec6'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Creating offline snapshot 81dea8e3-3cc4-4480-821b-2147ad9233c1 of volume a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[2108137e-f4b3-490c-a02b-5c1b3c172916]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:47 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Volume volume-f80adebf-3612-4e5c-b65e-565451d6c83a (f80adebf-3612-4e5c-b65e-565451d6c83a): created successfully
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabaef58-afd8-463f-b785-bbbb9ac56cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Flow 'volume_create_manager' (d5708c28-e2c6-4123-83ad-dff8631b630e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:47 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:47 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:47 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ebe99f27-182d-4e54-804f-b9af7008fa95 tempest-CinderUnicodeTest-843941728 None] Created volume successfully.
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:47 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:47 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:47 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:48 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.521s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:48 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b
Apr 13 11:27:48 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:48 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.497s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:48 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 1G
Apr 13 11:27:48 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:48 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.432s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:48 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Deleted volume successfully.
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-9f0a697d-a9be-4a5e-8bc0-3fd4afa0aa83 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-177d1b1f-5559-4523-976f-27fb20f74540-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:48 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b" returned: 0 in 0.470s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:48 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b
Apr 13 11:27:48 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-1bfc2305-1ea5-4927-a379-27a64ba122bb-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-1bfc2305-1ea5-4927-a379-27a64ba122bb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-quobyte-1bfc2305-1ea5-4927-a379-27a64ba122bb" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-1bfc2305-1ea5-4927-a379-27a64ba122bb" acquired by "delete_volume" :: waited 0.020s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f31f20f-efaf-4e63-8db0-462263a25b91]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:48 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb
Apr 13 11:27:48 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82099) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 11:27:48 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Flow 'volume_create_manager' (5aa94892-f9f8-49c9-a529-11c4badb2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9854be-fbe5-4b04-ac20-275c7acc16a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 1G" returned: 0 in 0.627s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:48 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f9854be-fbe5-4b04-ac20-275c7acc16a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1889045991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e1f918-d03a-4b67-9f24-401d6f5d1b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d775b8dbd74aa2a998cbc19e872728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:49Z,use_quota=True,user_id='e9dff2143b2f45deb7d5bff91e4a6510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:48 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bd08e7-894c-46b2-b04e-b2e7dbed8abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bd08e7-894c-46b2-b04e-b2e7dbed8abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e91fe5-25e6-40fb-9f0c-7fbedd1e3ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e91fe5-25e6-40fb-9f0c-7fbedd1e3ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e1f918-d03a-4b67-9f24-401d6f5d1b18', 'volume_name': 'volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4765838b-a5f8-4e50-ab18-283d01acbf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4765838b-a5f8-4e50-ab18-283d01acbf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646a2507-34c4-4d17-953b-35af5504b7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:48 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Volume a8e1f918-d03a-4b67-9f24-401d6f5d1b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18', 'volume_size': 1}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:48 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8.485d3641-7d4f-4d1e-a7e4-385ec8030b5b" returned: 0 in 0.459s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-485d3641-7d4f-4d1e-a7e4-385ec8030b5b" released by "_delete_snapshot" :: held 2.193s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:48 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" released by "delete_snapshot" :: held 2.208s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Created reservations ['9c1f71e6-1006-41e5-b978-b728e973f969', 'b6c47882-332d-4387-8b70-416be71355c6', '81ccea8f-8474-4d39-9153-a53d4500e82c', 'fa987262-dba9-400a-a76f-779de4047dee'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:49 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Delete snapshot completed successfully.
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-5b9a06d1-7cd2-42de-a55f-b9478bdefe0d tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-485d3641-7d4f-4d1e-a7e4-385ec8030b5b-delete_snapshot" released by "delete_snapshot" :: held 2.307s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:49 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb" returned: 0 in 0.537s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:49 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb
Apr 13 11:27:49 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:49 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1" returned: 0 in 0.485s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:49 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 is being set with open permissions: ugo+rw
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:49 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1
Apr 13 11:27:49 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:49 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-1bfc2305-1ea5-4927-a379-27a64ba122bb" returned: 0 in 0.413s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-1bfc2305-1ea5-4927-a379-27a64ba122bb" released by "delete_volume" :: held 0.977s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created reservations ['ac3bda26-09a5-4705-838f-0dc4f781fd26', '0dbbb345-114a-405b-afac-9871cb81fe05', 'ffdb6872-ac0a-4638-9545-bc4318b83a82', '8d2d0203-57e0-4f0a-925c-43d026080a9a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-ba98ce12-a5cd-4e1c-8e39-f9070a624459-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:49 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:49 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:49 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-ba98ce12-a5cd-4e1c-8e39-f9070a624459-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-quobyte-ba98ce12-a5cd-4e1c-8e39-f9070a624459" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-ba98ce12-a5cd-4e1c-8e39-f9070a624459" acquired by "delete_volume" :: waited 0.021s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:49 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info
Apr 13 11:27:49 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-b8109762-ff74-4f4d-bdc8-a47bd084a6d8-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3d845-6eac-49ca-a8d0-01139fa3adf8]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-b8109762-ff74-4f4d-bdc8-a47bd084a6d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-quobyte-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:49 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" acquired by "delete_volume" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88b754f-a445-4995-ba0d-958b8eccbb6c]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:50 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459
Apr 13 11:27:50 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:50 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:50 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:50 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.500s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:50 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Deleted volume successfully.
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-97f10414-a1f5-419b-b7d1-668d911cd5d9 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-1bfc2305-1ea5-4927-a379-27a64ba122bb-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:50 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info" returned: 0 in 0.425s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info is being set with open permissions: ugo+rw
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:50 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info
Apr 13 11:27:50 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:50 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459" returned: 0 in 0.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:50 devstack sudo[90369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459
Apr 13 11:27:50 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:50 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:50 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8
Apr 13 11:27:50 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:50 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.info" returned: 0 in 0.438s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-e643b259-9927-461b-934d-58597040b34f" by "_copy_volume_from_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-e643b259-9927-461b-934d-58597040b34f" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] snapshot: 81dea8e3-3cc4-4480-821b-2147ad9233c1, volume: e643b259-9927-461b-934d-58597040b34f,  {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[00766720-6211-40ea-9e29-4b744981325f]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:50 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-ba98ce12-a5cd-4e1c-8e39-f9070a624459" returned: 0 in 0.420s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1
Apr 13 11:27:50 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-ba98ce12-a5cd-4e1c-8e39-f9070a624459" released by "delete_volume" :: held 0.956s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created reservations ['5c9a6d67-b090-4849-b821-b6c8f688ab8f', '4727ae07-d438-4a39-833e-941216cd45e1', '73110830-026c-42a4-a584-59c4c3e830b3', 'a8f274b3-abd4-4066-971e-e0113c6fd181'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:50 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" returned: 0 in 0.466s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:50 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-b8109762-ff74-4f4d-bdc8-a47bd084a6d8" released by "delete_volume" :: held 1.008s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:51 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:51 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Created reservations ['17450451-f5cf-4398-b7ca-d03cb028b4bd', '1b482dc8-3ecf-475c-9654-aa82b1aa78ae', '03340814-3b8d-462f-a6f7-e0efcfdf8d6a', '2126a9b3-be02-40b0-841c-41fc1589665a'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:51 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:51 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:51 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1" returned: 0 in 0.514s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Creating direct copy from snapshot {{(pid=82099) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b49708-d2bd-4d62-8216-00a11eeab7a5]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:51 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:51 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:51 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.421s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Deleted volume successfully.
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-80b20cfb-1c25-4f19-ac36-0141483ee136 tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-ba98ce12-a5cd-4e1c-8e39-f9070a624459-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:51 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.428s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:51 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Deleted volume successfully.
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-dddec8ae-50ba-46d0-889b-338f8ff1bb35 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-b8109762-ff74-4f4d-bdc8-a47bd084a6d8-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:51 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.510s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG cinder.utils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Path /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f not found in is_blk_device check {{(pid=82099) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 11:27:51 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:51 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f
Apr 13 11:27:51 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-55afedbb-38f6-486d-af9a-0e2b1a312f98-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-55afedbb-38f6-486d-af9a-0e2b1a312f98-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "cinder-quobyte-55afedbb-38f6-486d-af9a-0e2b1a312f98" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-55afedbb-38f6-486d-af9a-0e2b1a312f98" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[f236ff11-b9e6-4d9d-819d-579979fbae90]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-d633f5ef-b78d-49ed-ba9a-85e6659773e5-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-d633f5ef-b78d-49ed-ba9a-85e6659773e5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "cinder-quobyte-d633f5ef-b78d-49ed-ba9a-85e6659773e5" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-d633f5ef-b78d-49ed-ba9a-85e6659773e5" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:52 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98
Apr 13 11:27:52 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c5e9fe-f912-4c0e-8ad3-5c0efb7ac7b1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:52 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:52 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5
Apr 13 11:27:52 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:53 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98" returned: 0 in 1.268s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:53 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98
Apr 13 11:27:53 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:53 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5" returned: 0 in 1.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:53 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:53 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5
Apr 13 11:27:53 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:54 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f" returned: 0 in 2.344s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[6212d8c0-4603-49b9-9af8-b842a164d648]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:54 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:54 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:54 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-d633f5ef-b78d-49ed-ba9a-85e6659773e5" returned: 0 in 0.698s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:54 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-55afedbb-38f6-486d-af9a-0e2b1a312f98" returned: 0 in 1.006s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-quobyte-d633f5ef-b78d-49ed-ba9a-85e6659773e5" released by "delete_volume" :: held 2.210s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-quobyte-55afedbb-38f6-486d-af9a-0e2b1a312f98" released by "delete_volume" :: held 2.300s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Created reservations ['343e032a-fb5b-4ccc-8df7-570c0e8b852e', '0a38333f-642f-4318-8b5b-4991661f2d59', 'fc8426db-66b2-4f02-a514-01be126e8a04', '09c9b91f-8d54-4757-9a7c-1c0c5daa8d9d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Created reservations ['bd89d7d2-0932-4889-bb31-1f7e441f0074', 'c82e26a7-47ea-4921-bfcb-af539424d876', 'f32f88ba-8d32-44da-aad3-e34f37f21cb5', '728ba26b-229a-406e-b668-27f750f0bfbe'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:54 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:54 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:54 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:54 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:54 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.634s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.image.image_utils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Image conversion details: src /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f {{(pid=82099) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 11:27:54 devstack cinder-volume[82099]: INFO cinder.image.image_utils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Converted 1024.00 MB image at 436.61 MB/s
Apr 13 11:27:54 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f is being set with open permissions: ugo+rw
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:54 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f
Apr 13 11:27:54 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:54 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.431s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Deleted volume successfully.
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-fcf8d8f5-fcba-425b-8a65-66309d0dcfe3 tempest-SnapshotDependencyTests-1599762827 None] Lock "cinder-d633f5ef-b78d-49ed-ba9a-85e6659773e5-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:54 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.426s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:27:54 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Deleted volume successfully.
Apr 13 11:27:54 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-24da0f9f-99bf-46b3-ab15-ca9535b54e9d tempest-CreateVolumesFromSourceVolumeTest-1371654719 None] Lock "cinder-55afedbb-38f6-486d-af9a-0e2b1a312f98-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:55 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f" returned: 0 in 0.429s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-e643b259-9927-461b-934d-58597040b34f" released by "_copy_volume_from_snapshot" :: held 4.475s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-81dea8e3-3cc4-4480-821b-2147ad9233c1" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-81dea8e3-3cc4-4480-821b-2147ad9233c1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Deleting offline snapshot 81dea8e3-3cc4-4480-821b-2147ad9233c1 of volume a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] snapshot_file for this snap is: volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbbdfbd-6269-4b2e-87d4-ff56f66b1a47]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:55 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1
Apr 13 11:27:55 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:55 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1" returned: 0 in 0.561s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4c08c-1ea8-49e9-9fcf-0cc743e820b8]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:55 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:55 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:55 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:56 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.671s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:56 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:56 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1
Apr 13 11:27:56 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:57 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1" returned: 0 in 0.494s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:57 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1
Apr 13 11:27:57 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:57 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb.81dea8e3-3cc4-4480-821b-2147ad9233c1" returned: 0 in 0.463s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-81dea8e3-3cc4-4480-821b-2147ad9233c1" released by "_delete_snapshot" :: held 2.249s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.879s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.611s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fa501b1c2b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T09:27:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1889045991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e1f918-d03a-4b67-9f24-401d6f5d1b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d775b8dbd74aa2a998cbc19e872728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:27:49Z,use_quota=True,user_id='e9dff2143b2f45deb7d5bff91e4a6510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a7ab3c-68b2-4415-b7e5-82254cc8ce84),volume_type_id=d3a7ab3c-68b2-4415-b7e5-82254cc8ce84)}" {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Creating volume a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Selected osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d as target Quobyte volume. {{(pid=82099) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 11:27:57 devstack cinder-volume[82099]: INFO cinder.volume.drivers.remotefs [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] casted to osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 1073741824 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:57 devstack sudo[90454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 1073741824
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e4b918-cc24-42f5-9527-deec0c6c8650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e643b259-9927-461b-934d-58597040b34f', 'volume_size': 1, 'source_volid': 'a8e1f05c-9f86-4020-adfb-a72166e2fbfb', 'source_volstatus': 'available'}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:57 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13964be-7a24-45c9-becd-e91504bbfb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:57 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Volume volume-e643b259-9927-461b-934d-58597040b34f (e643b259-9927-461b-934d-58597040b34f): created successfully
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13964be-7a24-45c9-becd-e91504bbfb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:57 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Flow 'volume_create_manager' (3d2755fd-b25c-475d-9647-adb98a2309c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:57 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-db4e1abf-e619-427a-b28e-13313a3fd58b tempest-VolumeDependencyTests-1445316855 None] Created volume successfully.
Apr 13 11:27:58 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 1073741824" returned: 0 in 0.647s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-a8e1f05c-9f86-4020-adfb-a72166e2fbfb-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-a8e1f05c-9f86-4020-adfb-a72166e2fbfb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:58 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18
Apr 13 11:27:58 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" acquired by "delete_volume" :: waited 0.008s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e3864c-31ae-4f59-b2d5-1ba8784e8706]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:58 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:58 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:58 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" returned: 0 in 0.567s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'} {{(pid=82099) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646a2507-34c4-4d17-953b-35af5504b7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18', 'volume_size': 1}' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4459244e-7c47-4585-a8d3-7fbe34b4eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 11:27:58 devstack cinder-volume[82099]: INFO cinder.volume.flows.manager.create_volume [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Volume volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 (a8e1f918-d03a-4b67-9f24-401d6f5d1b18): created successfully
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4459244e-7c47-4585-a8d3-7fbe34b4eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82099) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Flow 'volume_create_manager' (5aa94892-f9f8-49c9-a529-11c4badb2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82099) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 11:27:58 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-23b16ca8-8012-4414-a292-dcad24039932 tempest-CinderUnicodeTest-843941728 None] Created volume successfully.
Apr 13 11:27:58 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.599s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:58 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:58 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb
Apr 13 11:27:58 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:59 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" returned: 0 in 0.473s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-a8e1f05c-9f86-4020-adfb-a72166e2fbfb" released by "delete_volume" :: held 1.108s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Created reservations ['519aa767-3ad6-4d93-b01f-e6cb00e9c572', 'e362bf3f-9ad0-4f1a-afd9-053377a7c26f', '9bafd158-96d6-449f-b555-a9f284e25a36', '4e11daef-ce06-4d7e-8217-74975b770f65'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:59 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:27:59 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Creating offline snapshot 47883787-48e2-4693-8035-b3c3b6a687a7 of volume a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab56e204-a68c-4ebc-858e-fcb8b70e52e7]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:27:59 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:27:59 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18
Apr 13 11:27:59 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:00 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.501s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:28:00 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Deleted volume successfully.
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-1e05839e-9fd6-4612-a31a-6f4d64131187 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-a8e1f05c-9f86-4020-adfb-a72166e2fbfb-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:00 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" returned: 0 in 0.538s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 1G {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:00 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 1G
Apr 13 11:28:00 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-e643b259-9927-461b-934d-58597040b34f-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-e643b259-9927-461b-934d-58597040b34f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-e643b259-9927-461b-934d-58597040b34f" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-e643b259-9927-461b-934d-58597040b34f" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08ee8f-04e9-4600-b87f-e1e6254113a1]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:00 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f
Apr 13 11:28:00 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:00 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 1G" returned: 0 in 0.585s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:00 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:00 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7
Apr 13 11:28:00 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:01 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f" returned: 0 in 0.578s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:01 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f
Apr 13 11:28:01 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:01 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 -F qcow2 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7" returned: 0 in 0.543s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:01 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 is being set with open permissions: ugo+rw
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:01 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7
Apr 13 11:28:01 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:01 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-e643b259-9927-461b-934d-58597040b34f" returned: 0 in 0.486s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-e643b259-9927-461b-934d-58597040b34f" released by "delete_volume" :: held 1.091s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Created reservations ['63f4c8d2-1648-47e9-b031-9e11eb9d347a', 'ceb9a802-d730-4ab3-aa57-df63539f717d', '3ffb9b3d-6b0e-47eb-aa0e-2a407c6e9c76', '2ed3278d-b4af-4945-b495-9e614d776102'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:01 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:28:01 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:01 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7" returned: 0 in 0.526s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:01 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:01 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info
Apr 13 11:28:01 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:02 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.453s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:28:02 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Deleted volume successfully.
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-c5be0c43-78d0-4216-88e9-928041916342 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-e643b259-9927-461b-934d-58597040b34f-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:02 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info" returned: 0 in 0.404s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:02 devstack cinder-volume[82099]: WARNING cinder.volume.drivers.remotefs [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info is being set with open permissions: ugo+rw
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:02 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info
Apr 13 11:28:02 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-208e276a-d0f3-4e83-82ab-a7550499d797-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-208e276a-d0f3-4e83-82ab-a7550499d797-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "cinder-quobyte-208e276a-d0f3-4e83-82ab-a7550499d797" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-208e276a-d0f3-4e83-82ab-a7550499d797" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312b92b-1f76-482d-97b9-da63e36cc24e]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:02 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797
Apr 13 11:28:02 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:02 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.info" returned: 0 in 0.445s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:02 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:28:02 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-ab93c4d4-5eb0-4536-b5d2-5ae52e748d52 tempest-CinderUnicodeTest-843941728 None] Create snapshot completed successfully
Apr 13 11:28:03 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797" returned: 0 in 0.481s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:03 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797
Apr 13 11:28:03 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:03 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-208e276a-d0f3-4e83-82ab-a7550499d797" returned: 0 in 0.413s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-quobyte-208e276a-d0f3-4e83-82ab-a7550499d797" released by "delete_volume" :: held 0.926s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Created reservations ['f87e898b-1949-4fdb-b4f0-f80db83aa72e', '5b812692-621b-45ad-b84c-a8b2a1b1c7bc', 'a3ff7359-2ef0-4be0-8d13-c15af2a22cdc', '04a41c2c-70b0-4a27-8d49-2e209fa517d2'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:03 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:28:03 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-47883787-48e2-4693-8035-b3c3b6a687a7-delete_snapshot" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Lock "cinder-47883787-48e2-4693-8035-b3c3b6a687a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-quobyte-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" by "delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-quobyte-47883787-48e2-4693-8035-b3c3b6a687a7" by "_delete_snapshot" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-47883787-48e2-4693-8035-b3c3b6a687a7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Deleting offline snapshot 47883787-48e2-4693-8035-b3c3b6a687a7 of volume a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] snapshot_file for this snap is: volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 {{(pid=82099) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecae318c-4473-4e48-b341-e6317690cc48]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:28:03 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:04 devstack sudo[90523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7
Apr 13 11:28:04 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:04 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.492s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:28:04 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Deleted volume successfully.
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-afa85f60-f478-4053-92fa-40a4e18ab793 tempest-VolumeDependencyTests-1445316855 None] Lock "cinder-208e276a-d0f3-4e83-82ab-a7550499d797-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:04 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7" returned: 0 in 0.552s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.remotefs [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82099) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d227d8a-f59a-4853-b09b-2938dc5a731d]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:28:04 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:04 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18
Apr 13 11:28:04 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:05 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" returned: 0 in 0.502s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:05 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7
Apr 13 11:28:05 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:05 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7" returned: 0 in 0.452s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:05 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7
Apr 13 11:28:05 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:05 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18.47883787-48e2-4693-8035-b3c3b6a687a7" returned: 0 in 0.417s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-47883787-48e2-4693-8035-b3c3b6a687a7" released by "_delete_snapshot" :: held 1.992s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" released by "delete_snapshot" :: held 2.004s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Created reservations ['b23b2220-d383-44b1-9914-8edd35264c22', 'f8208abe-f688-4ffa-995d-9269a37d74e0', '5e5ef865-68c9-448a-b85e-fc0381f057fc', '583d4acd-2b22-44a2-b680-2346d9429ba1'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:28:05 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Delete snapshot completed successfully.
Apr 13 11:28:05 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-8c4f1ce5-ff3d-48a1-b839-d7f62dc290ca tempest-CinderUnicodeTest-843941728 None] Lock "cinder-47883787-48e2-4693-8035-b3c3b6a687a7-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-a8e1f918-d03a-4b67-9f24-401d6f5d1b18-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Lock "cinder-a8e1f918-d03a-4b67-9f24-401d6f5d1b18-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-quobyte-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e5a80-3f6d-4744-9785-c61e3d02d638]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:07 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18
Apr 13 11:28:07 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:07 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" returned: 0 in 0.478s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:07 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18 {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:07 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18
Apr 13 11:28:07 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:08 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" returned: 0 in 0.438s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-a8e1f918-d03a-4b67-9f24-401d6f5d1b18" released by "delete_volume" :: held 0.945s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Created reservations ['ed4d4b2a-bb48-4d7f-8993-8b975e63fff5', '76ba1ba7-5ab9-4486-b695-a1ac145a9deb', '76842673-b1bf-402d-a33d-82f44d66f74b', '14a02ca9-5ca4-44b9-af01-fa5f00929d5d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:08 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:28:08 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-f80adebf-3612-4e5c-b65e-565451d6c83a-delete_volume" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Lock "cinder-f80adebf-3612-4e5c-b65e-565451d6c83a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Acquiring lock "cinder-quobyte-f80adebf-3612-4e5c-b65e-565451d6c83a" by "delete_volume" {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-f80adebf-3612-4e5c-b65e-565451d6c83a" acquired by "delete_volume" :: waited 0.006s {{(pid=82099) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo.privsep.daemon [-] privsep: reply[76526fe2-04fd-4781-810b-8a093082bc09]: (4, 'qcow2') {{(pid=83086) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:08 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a
Apr 13 11:28:08 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:08 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.425s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:28:08 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Deleted volume successfully.
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-60afba69-cfbe-439e-ba57-fa4939b95703 tempest-CinderUnicodeTest-843941728 None] Lock "cinder-a8e1f918-d03a-4b67-9f24-401d6f5d1b18-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:08 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a" returned: 0 in 0.511s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:08 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:08 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a
Apr 13 11:28:08 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:09 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f/volume-f80adebf-3612-4e5c-b65e-565451d6c83a" returned: 0 in 0.409s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Lock "cinder-quobyte-f80adebf-3612-4e5c-b65e-565451d6c83a" released by "delete_volume" :: held 0.940s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG cinder.quota [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Created reservations ['d4a36b76-dabc-42fc-9d90-4171c3ed772c', '1f1df35d-be20-402e-ae59-4d1e4e762dae', '25beab97-4be8-4b8b-82c4-cbec14906165', '6d048519-1670-48d4-8fde-5ac093c31b4d'] {{(pid=82099) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:09 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:28:09 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:09 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.471s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:28:09 devstack cinder-volume[82099]: INFO cinder.volume.manager [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Deleted volume successfully.
Apr 13 11:28:09 devstack cinder-volume[82099]: DEBUG cinder.coordination [None req-bc8fe897-b53f-406d-bf87-a3bf719f374b tempest-CinderUnicodeTest-843941728 None] Lock "cinder-f80adebf-3612-4e5c-b65e-565451d6c83a-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82099) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG oslo_service.periodic_task [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82099) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d': None} {{(pid=82099) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG cinder.volume.drivers.quobyte [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c35e8ebb-0d49-4aae-9819-6f5e72ba553d'] {{(pid=82099) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.lockutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82099) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 11:28:10 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 11:28:10 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f
Apr 13 11:28:10 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 11:28:11 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 13 11:28:11 devstack cinder-volume[82099]: DEBUG oslo_concurrency.processutils [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5c46e72101ba508220395b768cd9232f" returned: 0 in 0.422s {{(pid=82099) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 11:28:11 devstack cinder-volume[82099]: DEBUG cinder.manager [None req-3beba4a3-80e0-4207-b599-846c579b5b00 None None] Notifying Schedulers of capabilities ... {{(pid=82099) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 11:28:19 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=225,cinder:SELECT=168,cinder:INSERT=61,cinder:DELETE=14 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 11:28:19 devstack cinder-volume[82099]: DEBUG dbcounter [-] [82099] Writing DB stats cinder:UPDATE=221,cinder:DELETE=22,cinder:SELECT=145,cinder:INSERT=50 {{(pid=82099) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}